AI Data Annotation Specialist

Job Title: Application Programmer III

Location: Charlotte, NC

Duration: Contract - 12 months

Pay Range: $56.08/hr (W2)

Job ID: 373918

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Job Description

We are seeking an AI Data Annotation Training Data Contractor to join our dynamic team. The ideal candidate will have strong experience in AI/ML data labeling, QA, and evaluation across NLP, information retrieval, entity extraction, routing/classification, semantic search, and RAG/LLM applications, and a proven ability to deliver accurate, consistent annotations and evaluation datasets at scale.

Responsibilities:

• Annotate and label large datasets for AI/ML training and evaluation tasks across text, tabular, and retrieval workflows.


• Create labels for query classification, intent detection, entity and time extraction, metric identification, semantic similarity, relevance ranking, and document retrieval quality.


• Tag and classify user queries, documents, entities, metadata, tool routing, structured vs. unstructured query type, human preference, and LLM response quality.


• Perform QA reviews to ensure consistency, accuracy, completeness, and adherence to acceptance criteria; escalate ambiguities and edge cases.


• Participate in inter-annotator agreement, calibration sessions, and feedback loops to refine dataset quality.


• Assist in building evaluation datasets, benchmark suites, and golden sets for classifiers, retrieval systems, and LLM generation quality.


• Review AI outputs, provide structured scoring and feedback, and help identify failure modes, hallucinations, routing issues, and retrieval gaps.


• Follow detailed annotation specifications and operational procedures; document decisions, edge cases, and standards.


• Support taxonomy and schema refinement; organize datasets, metadata, and labeling workflows across tools and platforms.


• Work effectively within Agile development practices and collaborate with data science, ML engineering, and platform teams.

Required Skills & Qualifications:

• Bachelor's degree or equivalent practical experience.


• Experience with data annotation, data labeling, QA, research operations, or analytical workflows.


• Ability to follow complex technical instructions and detailed labeling guidelines with high accuracy.


• Strong attention to detail, organizational skills, and written communication.


• Comfort with large datasets, structured processes, spreadsheets, and labeling interfaces.


• Ability to work independently, manage priorities, and meet deadlines in a fast-paced environment.

Preferred Skills:

• Familiarity with RAG, LLM evaluation, semantic search, and information retrieval concepts.


• Experience working in Agile/Scrum settings and collaborating with ML engineering teams.

Why BCforward?

At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to:

• Competitive compensation and benefits.


• Opportunities for growth with global clients.


• A supportive, inclusive culture that values innovation and people.


• Exposure to cutting-edge technologies and projects.

About Our Commitment

BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.

Interested? Apply Now!

If this sounds like the right opportunity for you, please apply with your most recent resume.