A shark warning has been issued for a popular bay in Perth’s south after a large shark bumped a kayak multiple times.