New version is taking too long to building report... #215
Comments
|
Hi @fepere There are some new steps to collect extra data in this version. Running the script with -Debug we can see what exactly the script is doing, with that, can you tell me the following: The script is getting "stuck" at some specific part? In case the script is running normally, but is just taking longer, at which part is actually taking longer than used to? Thanks |
|
Yes, it's stuck here: DEBUG: 2024-09-08_23_47_23 - Running Module: 'ServiceBUS'. Lines Count: 476 since last friday DEBUG: 2024-09-05_21_03_29 - Debbuging Mode: On. ErrorActionPreference was set to "Continue", every error will be presented. |
|
The script took 8 hours to send the Load Balancers to the Excel file after the processing was done. The script usually take longer times to process the resources, not to send them to the Excel File... Apparently something is wrong here. How much memory is the Powershell process consuming? |
|
yes, it's taking more then 20G as you can see the screenshot
|
|
This should also be addressed in the version 3.5.1, can you try it and see how it goes? Thanks |
|
Hi @Claudio-Merola DEBUG: 2024-09-12_17_41_02 - Debbuging Mode: On. ErrorActionPreference was set to "Continue", every error will be presented. DEBUG: 2024-09-12_17_41_57 - Number of Subscriptions Found: 411 DEBUG: 2024-09-12_19_08_42 - Excel file: C:\AzureResourceInventory\AzureResourceInventory_Report_2024-09-12_19_08.xlsx DEBUG: 2024-09-12_19_09_01 - Starting Resource Jobs. Still running, now it's 8:45PM - GMT-3 Please take a look and let me know Thanks |
|
Hi @Claudio-Merola, in this new version, and in the previous one, when generating the Report, the process remains stopped after the LoadBalanced Module, I left the process running for more than 24 hours, and it did not pass 78%. DEBUG: 2024-09-12_14_17_21 - Running Module: 'AppGW'. Lines Count: It works well for most subscriptions. Thanks for your effort. |
|
@fepere It is still running in what phase? Is that after the processing jobs? How much memory is the process consuming now? @Rodzmig Is the Excel file populated with the Load Balancer's data? 178k lines is a lot of lines for the script to process, how much memory the powershell process is consuming? |
|
@Claudio-Merola DEBUG: 2024-09-13_10_30_33 - initial Jobs Running: 1 The pwsh is consuming +/- 20GB as you can see the screenshot
|
|
@Claudio-Merola, It consumes between 3.9 and 4.3 GB of RAM, but in the end I had to kill the process, and it was not reflected in the report. |
|
@Claudio-Merola, but Count: 178524, is the number of resources?, If I check it manually, it only has 2 load balancers.
|
|
Can you try the version 3.5.2? Run it with the parameter "-Heavy" please |
|
Hi @Claudio-Merola This is the command that I'm using: here is the error: Extracting Subscriptions from Tenant Microsoft.Azure.Commands.Profile.Models.Core.PSAzureContext xxxxxxxx-xxxxxxx See the number of subscription is 0 but this is not true. Can you please check if you using SPN the system.object cause the problem to get the tenantid? |
|
I changed the Login behavior of the module when using SPN. Can you try the version 3.5.3 and see if this is working as before? |
|
Hi @Claudio-Merola |
|
Hey @Claudio-Merola |
|
Ola @fepere Eu alterei o parametro do SPN para receber o secret como plaintext ao invés de securestring |
|
Olá @Claudio-Merola Invoke-ARI: Cannot process argument transformation on parameter 'Secret'. Cannot convert the value of type "System.String" to type "System.Security.SecureString". Depois tentei fazer o AsSecureString e tbem não funciona: PS C:\Users\azureuser\Downloads> $SecurePassword = Read-Host -Prompt 'Enter a Password' -AsSecureString Ele não conecta com a SPN. Obrigado |
|
Olã @Claudio-Merola Um ponto importante, estou usando a versão anterior ao do módulo e não temos esse problema de performance e o relatório é concluído para 405 subscriptions + 200k resources em +- 30 minutos. Gostaria de te pedir para avaliar essa mudança pq o impacto está sendo grande e a nova versão deixei rodando por 2 dias e não termina, consumindo toda a memoria do recurso, mudei de 16gb para 32gb e mesmo assim não funciona. |
|
Ola @fepere Eu acabei de atualizar a versão do modulo para 3.5.4. O SPN deve estar funcionando agora. Passe o SPN como plaintext. Quanto a performance, é bem estranho este comportamento, não alteramos a forma como o script processa as informações. Executando o script com o parametro -Debug, em qual parte o script fica "parado"? |
Hello @Claudio-Merola,
The previous version takes ~28 min to cover +/-390 subscriptions, now this new version is taking forever. more than 4 hours already.
also, I had tried the Automation account and get suspended.
I had enabled the debug but now able to find any issues.
Can you please take a look on that?
Thx
The text was updated successfully, but these errors were encountered: