Deleting connector does not delete tasks

I tried deleting a debezium mysql connector and I'm noticing that the task associated with it is still in a RUNNING state:

curl platform-connect-api:8083/connectors/discogs-releases | jq
{
  "error_code": 404,
  "message": "Connector discogs-releases not found"
}

curl platform-connect-api:8083/connectors/discogs-releases/tasks/0/status | jq
{
  "id": 0,
  "state": "RUNNING",
  "worker_id": "10.22.7.178:8083"
}

There are some details that might be relevant:

• After deleting the connector, I tried deleting the main topic, the history topic and the connect-offset-topic
• After all of that I'm now getting a stream of warnings in the connect logs like this:

2020-01-09 18:51:36,715 WARN [Producer clientId=producer-2] Received invalid metadata error in produce request on partition connect-cluster-status-0 due to org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition.. Going to request metadata update now (org.apache.kafka.clients.producer.internals.Sender) [kafka-producer-network-thread | producer-2]