feat/added bedrock streaming

[lloydhamilton]

What does this PR do?

Added streaming functionality for Bedrock API integration. Followed as closely as possible the coding styles written in openai_client.py and ollama_client.py.

• Added api call to bedrock .converse_stream endpoint when streaming is true.
• To enable streaming, set streaming = True is api_kwargs.

client = BedrockAPIClient(aws_profile_name="test_profile", aws_region_name="eu-west-1")
model_kwargs = {
    "modelId": "eu.anthropic.claude-3-5-sonnet-20240620-v1:0",
    "stream": True,
}

Since the stream parameter is not a parameter recognised by Bedrock, I had to add api_kwargs.pop("stream") when evaluating api_kwargs prior to bedrock API call.

Related issue:
#283

Add tests that extends the tests written in #289

Before submitting

• Was this discussed/agreed via a GitHub issue? (not for typos and docs)
• Did you read the contributor guideline?
• Did you make sure your PR does only one thing, instead of bundling different changes together?
• Did you make sure to update the documentation with your changes? (if necessary)
• Did you write any new necessary tests? (not for typos and docs)
• Did you verify new and existing tests pass locally with your changes?
• Did you list all the breaking changes introduced by this pull request?

[fm1320]

@lloydhamilton Hi, can you make sure tests pass locally too please, I will review

[lloydhamilton]

No probs, will get it fixed. I know what the issue is. Test passed locally on mine as I have a default AWS profile set up. Will mock those env vars.

[lloydhamilton]

hey @fm1320 I have updated the tests. Could you verify that the tests passed?

[fm1320]

Hi @lloydhamilton , any more updates or is this ready? It generally looks good I just want to test a few more things when its complete

[lloydhamilton]

Hey @fm1320 no more updates on my end for this PR. Do let me know how the tests go. I should be available to address any changes.