Hey @_Evan_Boyle - is sandbox support on the roadmap for Copilot CLI?
1
51
Biggest barrier I personally see to further adoption of GitHub Copilot is how far behind the experience and supported feature-set feels in Visual Studio compared to VSCode, Cursor etc. And combined with Copilot CLI being in Preview, it shifts attention elsewhere.
1
114
One of my biggest UX gripes with GitHub Copilot (in VS) is that you have to wait for the whole response to be generated before you can read it due to the auto-scrolling as the response streams in. Would be a big plus to be able to stop the auto-scroll!
57
Anyone else having issues with Azure OpenAI (timing out trying to connect via API, failing to load model deployments in Azure OpenAI Studio...)?
6
3
289
Good article (Azure OpenAI) on considerations for right-sizing your Provisioned Throughput deployment, spilling peak workloads over to PAYG for cost optimisation:
Right-size your PTU deployment and save big (microsoft.com)
1
84
Transitioning to Production with LLM capabilities, when you care about consistency of guaranteed throughput and latency is a key challenge that needs to be considered carefully up front.
1
1
67
Full Fibre 900 - £41.99/month
Full Fibre 900 for a customer of many years (me) - £55.54/month
Don't know what's going on with @Plusnet these days, but that's shocking. Making me wonder if longer term, it'll be wound down (as part of consolidating Plusnet/BT/EE, per mobile)
1
133
Any of my followers (or beyond) have experience with Amazon Bedrock for hosting LLMs (on a token usage basis and/or Provisioned Throughput basis)?
Keen to hear thoughts, experiences etc. Please RT!
1
64
Good to see a new Learning Path for Semantic Kernel on MS Learn:
devblogs.microsoft.com/seman…
2
59
Switched over recently to the new gen Planners (Handlebars) as part of Semantic Kernel v1.x upgrade.
Next step is to optimise the "plan generation" phase of a workflow. Generating plans is expensive (time and cost) and relatively prone to error.
1
1
70
Having significant latency issues with GPT 4-Turbo (1106-Preview) on Azure OpenAI, making it consistently, noticeably slower than GPT-4 (0613).
Anyone else encountering this?
e.g.
48.8s (GPT-4-Turbo) vs. 13.9s (GPT-4)
Snapshot times, so fluctuates, but wildly so for 4-Turbo.
1
1
154
Microsoft Graph activity logs (learn.microsoft.com/en-us/gr…) is long overdue. Finally able to get a tenant-wide view on usage - dusting off my KQL skills!
2
56
Finishing up prep for an internal talk I'll be giving tomorrow on the Semantic Kernel. There are demos, and then there are Generative-AI demos - let's hope it all behaves!
1
59
Just signed up for the Microsoft Build: AI Day at the London ExCel on 19th Oct - if anyone I know is heading there too, give me a shout :) msevents.microsoft.com/event…
I've been using the MS Semantic Kernel for a couple of months now to incorporate LLMs into POCs. At the heart of everything I do in this space now.
Recent focus has been on observability, getting prompt & completion token usage metrics. Cost & throughput optimisation important
1
1
125



