Lead Python Developer

iCapitalJaipur, IN

Apply with Sonara

Automate your job search with Sonara.

Submit 10x as many applications with less effort than one manual application.¹

Reclaim your time by letting our AI handle the grunt work of job searching.

We continuously scan millions of openings to find your top matches.

Overview

Schedule

Full-time

Career level

Senior-level

Remote

Hybrid remote

Benefits

Health Insurance

Dental Insurance

Paid Vacation

Job Description

iCapital is looking to hire an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate will have hands-on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related services. This role will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals.

Responsibilities

Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session or token-based login flows.
Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.
Integrate and manage complex workflows across multiple portals, APIs, and data sources.
Contribute to architectural decisions, tooling, and best practices.
Responsible for Code reviews and deployments.

Qualifications

Bachelor’s or master’s degree in computer science, software engineering, or related field, or equivalent professional experience
10+ years of experience in Python development, with a strong focus on automation and data extraction
Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests
In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session or cookie management
Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager
Experience with asynchronous programming, headless browsers, and JavaScript-rendered content
Solid understanding of web protocols (i.e. HTTP, HTTPS, cookies, headers), and the ability to reverse-engineer network calls and authentication mechanisms
Comfortable working with APIs, JSON/XML, and data transformation
Experience with CI or CD pipelines, Docker, and infrastructure as code (i.e. CloudFormation, Terraform)
Familiar with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions
Prior experience scraping from secure or enterprise-level portals (i.e. financial, healthcare, legal)
Background in data engineering or ETL workflows is a plus
Exposure to Python testing frameworks and writing unit or integration tests

We believe the best ideas and innovation happen when we are together. Employees in this role will work in the office four days, with the flexibility to work remotely one day (Friday). 

Benefits

iCapital offers a comprehensive benefits package that includes a total compensation program consisting of competitive salary, annual performance bonus, and equity for all full-time employees; healthcare with 100% employer-paid health and dental insurance; and generous paid time off (PTO).

For additional information on iCapital Network, please visit https://www.icapitalnetwork.com/about-us Twitter: @icapitalnetwork | LinkedIn: https://www.linkedin.com/company/icapital-network-inc

Automate your job search with Sonara.

Submit 10x as many applications with less effort than one manual application.

Apply with Sonara Apply manually

FAQs About Lead Python Developer Jobs at iCapital

What is the work location for this position at iCapital?

This job at iCapital is located in Jaipur, IN, according to the details provided by the employer. Some roles may also include multiple work locations depending on the requirement.

What pay range can candidates expect for this role at iCapital?

Employer has not shared pay details for this role.

What employment applies to this position at iCapital?

iCapital lists this role as a Full-time position.

What experience level is required for this role at iCapital?

iCapital is looking for a candidate with "Senior-level" experience level.

What benefits are offered by iCapital for this role?

iCapital offers following benefits: Health Insurance, Dental Insurance, Paid Vacation, and Health & Wellness Programs for this position. Actual benefits may vary depending on the employer's policies and employment terms.

What is the process to apply for this position at iCapital?

You can apply for this role at iCapital either through Sonara's automated application system, which helps you submit applications 10X faster with minimal effort, or by applying manually using the direct link on the job page.