is there anyway to limit to number of concurrent running pipelines?

Via Airflow? concurrency is set to 1 via https://gitlab.com/meltano/files-airflow/-/blob/master/bundle/orchestrate/dags/meltano.py#L27

Yeah, this'd be something to configure at the orchestrator level.