Oct 30 20:33:44.936740 ip-10-0-141-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 20:33:44.936753 ip-10-0-141-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 20:33:44.936760 ip-10-0-141-37 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 20:33:44.936976 ip-10-0-141-37 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 20:33:54.938142 ip-10-0-141-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 20:33:54.938157 ip-10-0-141-37 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 98b6489962904a26ad620dbdcf353fb1 --
Oct 30 20:35:52.522830 ip-10-0-141-37 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:35:52.951105 ip-10-0-141-37 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:35:52.951105 ip-10-0-141-37 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:35:52.951105 ip-10-0-141-37 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:35:52.951105 ip-10-0-141-37 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:35:52.955310 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955222    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:52.955310 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955311    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955316    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955320    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955324    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955326    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955329    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955331    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955334    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955337    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955340    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955342    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955345    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955348    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955350    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955353    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955355    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955358    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955360    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955363    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955365    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:52.955389 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955368    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955370    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955373    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955375    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955378    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955388    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955391    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955394    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955396    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955399    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955402    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955405    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955407    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955410    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955412    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955416    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955421    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955424    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955427    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:52.955936 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955431    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955435    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955438    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955440    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955443    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955445    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955448    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955456    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955460    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955462    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955465    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955468    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955471    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955474    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955476    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955479    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955482    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955485    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955487    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:52.956370 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955490    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955492    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955495    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955497    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955500    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955502    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955505    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955507    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955509    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955512    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955514    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955517    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955519    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955521    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955524    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955526    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955529    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955531    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955547    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955551    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:52.956861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955554    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955557    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955559    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955562    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955565    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955567    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955570    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955573    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955575    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955578    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955581    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955584    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955586    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955589    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955592    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955594    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955597    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955600    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955602    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955605    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:52.957329 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955607    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955610    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955612    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955615    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955617    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955620    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.955622    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956487    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956495    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956498    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956501    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956504    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956507    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956510    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956513    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956516    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956518    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956521    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956524    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956527    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:52.957808 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956529    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956532    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956552    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956557    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956560    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956563    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956565    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956568    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956571    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956574    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956576    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956579    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956581    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956584    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956587    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956589    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956592    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956594    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956597    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:52.958288 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956600    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956602    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956605    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956607    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956610    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956612    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956618    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956622    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956624    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956627    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956629    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956632    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956636    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956638    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956641    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956644    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956647    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956649    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956652    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956654    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:52.958743 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956658    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956662    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956665    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956669    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956672    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956675    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956677    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956680    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956682    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956685    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956688    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956690    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956693    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956695    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956698    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956700    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956703    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956705    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956709    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:52.959315 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956713    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956715    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956718    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956721    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956723    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956726    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956729    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956731    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956734    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956737    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956739    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956742    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956744    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956747    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956749    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956752    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956754    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956757    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956759    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956762    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:52.960015 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956764    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956767    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956770    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956772    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956775    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956777    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956780    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956782    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956785    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956787    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956790    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956793    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956796    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956799    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.956802    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957325    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957330    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957334    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957336    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957339    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:52.960483 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957342    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957345    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957347    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957350    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957353    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957355    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957358    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957361    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957363    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957366    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957369    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957371    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957374    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957376    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957379    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957381    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957384    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957387    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957389    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:52.960985 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957392    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957396    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957400    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957404    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957408    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957411    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957414    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957417    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957419    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957422    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957425    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957427    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957430    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957432    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957435    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957437    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957440    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957443    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957446    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:52.961430 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957448    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957451    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957453    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957456    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957458    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957461    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957463    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957466    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957468    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957471    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957473    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957476    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957478    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957480    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957483    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957485    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957488    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957492    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957494    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957497    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:52.961894 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957500    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957503    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957506    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957509    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957511    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957514    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957517    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957519    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957522    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957524    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957527    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957530    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957532    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957551    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957555    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957559    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957562    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957568    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957571    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957574    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:52.962367 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957576    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957579    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957581    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957584    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957586    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957589    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957591    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957594    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957597    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957602    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957606    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957609    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957611    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957615    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957618    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957621    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957624    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957626    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957629    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:52.962866 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957632    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957634    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957637    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.957641    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958718    2577 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958729    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958735    2577 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958741    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958746    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958750    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958755    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958759    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958763    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958766    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958770    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958773    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958776    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958779    2577 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958783    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958786    2577 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958789    2577 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958792    2577 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958798    2577 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:35:52.963310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958801    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958804    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958808    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958811    2577 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958815    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958819    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958822    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958825    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958828    2577 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958831    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958834    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958837    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958840    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958844    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958847    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958850    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958854    2577 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958857    2577 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958860    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958864    2577 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958867    2577 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958870    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958874    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958876    2577 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:35:52.963881 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958881    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958884    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958887    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958891    2577 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958894    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958897    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958900    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958903    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958907    2577 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958910    2577 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958913    2577 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958917    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958920    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958924    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958927    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958931    2577 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958934    2577 flags.go:64] FLAG: --help="false"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958937    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958941    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958943    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958946    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958950    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958953    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:35:52.964494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958956    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958959    2577 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958962    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958965    2577 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958968    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958971    2577 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958974    2577 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958977    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958980    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958983    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958986    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958989    2577 flags.go:64] FLAG: --lock-file=""
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958992    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958996    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.958999    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959005    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959009    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959012    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959015    2577 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959018    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959021    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959024    2577 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959027    2577 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959032    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959035    2577 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:35:52.965061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959039    2577 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959042    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959045    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959048    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959051    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959054    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959057    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959060    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959067    2577 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959070    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959073    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959076    2577 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959079    2577 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959081    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959084    2577 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959087    2577 flags.go:64] FLAG: --port="10250"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959090    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959093    2577 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-026756ef1d0c42d76"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959097    2577 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959100    2577 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959103    2577 flags.go:64] FLAG: --register-node="true"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959106    2577 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959110    2577 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959113    2577 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959115    2577 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959118    2577 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:35:52.965663 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959122    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959125    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959128    2577 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959131    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959134    2577 flags.go:64] FLAG: --runonce="false"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959138    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959141    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959145    2577 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959148    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959151    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959154    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959157    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959160    2577 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959163    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959166    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959169    2577 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959173    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959176    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959179    2577 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959182    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959187    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959192    2577 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959195    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959199    2577 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959205    2577 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:35:52.966288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959207    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959210    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959213    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959216    2577 flags.go:64] FLAG: --v="2"
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959221    2577 flags.go:64] FLAG: --version="false"
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959225    2577 flags.go:64] FLAG: --vmodule=""
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959231    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959236    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959444    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959454    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959459    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959462    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959464    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959468    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959471    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959474    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959477    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959479    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959482    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959484    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959487    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:52.966897 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959490    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959492    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959495    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959498    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959500    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959503    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959505    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959510    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959513    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959516    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959520    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959524    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959529    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959532    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959549    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959552    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959555    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959558    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959561    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:52.967391 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959564    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959566    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959569    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959571    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959574    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959577    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959580    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959582    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959585    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959588    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959590    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959593    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959595    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959598    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959601    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959603    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959606    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959608    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959611    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959613    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:52.967849 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959617    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959620    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959622    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959627    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959629    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959632    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959635    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959637    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959640    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959644    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959648    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959651    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959654    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959657    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959659    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959662    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959664    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959667    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959670    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:52.968306 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959673    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959676    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959679    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959681    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959684    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959686    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959689    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959691    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959694    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959696    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959698    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959701    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959704    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959708    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959710    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959713    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959717    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959719    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959722    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959725    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:52.968803 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959727    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959730    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959732    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959735    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959737    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959740    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959743    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959745    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959748    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959750    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959753    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959755    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959758    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959761    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959764    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.959794    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:35:52.969270 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959837    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959842    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959845    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959848    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959851    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959854    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959856    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959859    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959862    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959864    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959870    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959873    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959877    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959879    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959882    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959885    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959887    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959890    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959892    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:52.969654 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959895    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959897    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959900    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959902    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959905    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959908    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959910    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959913    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959915    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959918    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959920    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959923    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959926    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959929    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959931    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959934    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959936    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959939    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959941    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959944    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:52.970305 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959946    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959949    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959951    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959956    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959958    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959963    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959965    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959968    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959970    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959973    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959976    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959979    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959981    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959984    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959988    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959992    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959996    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.959999    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960002    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:52.970994 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960004    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960007    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960009    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960012    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960014    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960017    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960020    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960023    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960026    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960029    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960031    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960034    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960036    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960039    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960041    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960044    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960048    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960050    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960054    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960057    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:52.971437 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960060    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960063    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960065    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960068    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960070    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960073    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960075    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960078    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960080    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960083    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960085    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960088    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960092    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960095    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960098    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960101    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960104    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960106    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960110    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960112    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:52.971913 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960115    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960118    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960121    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960123    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960126    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960128    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960131    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.960133    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.967868    2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.967886    2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.968501    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.968508    2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968581    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968586    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968590    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968593    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968596    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968598    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968601    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:52.972368 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968605    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968609    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968612    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968615    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968617    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968620    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968623    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968625    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968628    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968630    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968633    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968635    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968638    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968640    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968643    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968645    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968648    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968650    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968653    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968655    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:52.972842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968659    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968662    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968665    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968668    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968671    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968673    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968677    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968682    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968685    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968688    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968691    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968694    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968696    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968699    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968701    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968704    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968706    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968709    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968711    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968714    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:52.973308 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968716    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968719    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968721    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968724    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968727    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968729    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968731    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968734    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968736    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968738    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968741    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968743    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968746    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968749    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968752    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968755    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968758    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968761    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968763    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:52.973796 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968766    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968768    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968771    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968773    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968775    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968778    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968780    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968783    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968785    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968787    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968790    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968792    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968795    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968798    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968800    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968803    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968805    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968808    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968812    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:52.974281 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968816    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968820    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968823    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968826    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968829    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968831    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968833    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968836    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968838    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968841    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968844    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968846    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968850    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968852    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968854    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968857    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968859    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968862    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968864    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968867    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:52.974783 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.968870    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.968899    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969062    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969067    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969070    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969074    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969077    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969080    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969083    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969086    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969089    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969092    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969094    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969097    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969099    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969102    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:52.975242 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969105    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969107    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969110    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969112    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969114    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969117    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969119    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969122    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969125    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969128    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969130    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969133    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969135    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969137    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969140    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969142    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969144    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969147    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969149    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969152    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:52.975620 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969155    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969157    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969160    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969162    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969165    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969168    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969170    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969172    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969175    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969177    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969180    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969183    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969185    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969187    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969190    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969192    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969195    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969197    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969199    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:52.976084 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969201    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969206    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969208    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969210    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969213    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969215    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969218    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969220    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969222    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969225    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969227    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969230    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969232    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969235    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969238    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969240    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969243    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969245    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969249    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:52.976523 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969253    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969256    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969260    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969263    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969266    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969268    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969271    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969274    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969276    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969279    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969281    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969284    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969286    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969288    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969291    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969294    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969296    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969298    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969301    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:52.976987 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969304    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969306    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969309    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969311    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969313    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969316    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969318    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969321    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969323    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969326    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969328    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969331    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969334    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969336    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969339    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.969361    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:35:52.977458 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969393    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969397    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969401    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969404    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969408    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969410    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969413    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969416    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969419    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969421    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969424    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969426    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969428    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969432    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969434    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969437    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969440    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969442    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969444    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:35:52.977982 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969447    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969450    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969452    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969454    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969457    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969460    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969462    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969464    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969467    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969470    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969472    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969474    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969476    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969479    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969481    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969484    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969486    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969488    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969491    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969493    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:35:52.978419 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969495    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969498    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969500    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969503    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969505    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969507    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969510    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969512    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969515    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969517    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969520    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969522    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969524    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969527    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969529    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969532    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969554    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969557    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969560    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969562    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:35:52.978933 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969564    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969567    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969569    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969572    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969574    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969577    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969579    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969582    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969584    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969587    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969589    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969592    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969594    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969596    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969599    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969601    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969603    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969606    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969608    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:35:52.979397 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969610    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969613    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969616    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969618    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969621    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969623    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969625    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969628    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969630    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969632    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969635    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969638    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969640    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969643    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969645    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969647    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969650    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969652    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969655    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969657    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:35:52.979980 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969660    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969664    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969666    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969669    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969671    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969674    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969676    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:52.969678    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.969729    2577 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.972580    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.973684    2577 server.go:1014] "Starting client certificate rotation"
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.973779    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.973811    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.975930    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:35:52.980452 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.977159    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:35:52.986524 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.986501    2577 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:35:52.988778 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.988763    2577 log.go:25] "Validated CRI v1 image API"
Oct 30 20:35:52.989624 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.989599    2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:35:52.995022 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.995003    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 91682a5f-0cfe-4796-aedd-b0465acbb083:/dev/nvme0n1p4 c2b35046-c748-4c02-9d1f-87c3aaa516e6:/dev/nvme0n1p3]
Oct 30 20:35:52.995090 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:52.995021    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 20:35:53.001155 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.001044    2577 manager.go:217] Machine: {Timestamp:2026-10-30 20:35:52.999704288 +0000 UTC m=+0.356777304 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101099 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27cf66c44c6d3e1cb620cf6a2abf04 SystemUUID:ec27cf66-c44c-6d3e-1cb6-20cf6a2abf04 BootID:98b64899-6290-4a26-ad62-0dbdcf353fb1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:55:ec:40:62:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:55:ec:40:62:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:48:e7:91:27:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:35:53.001692 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.001682    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:35:53.001776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.001765    2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:35:53.004734 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.004714    2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:35:53.004862 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.004736    2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-37.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:35:53.004906 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.004864    2577 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:35:53.004906 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.004871    2577 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:35:53.004906 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.004899    2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:35:53.004980 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.004913    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:35:53.005688 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.005678    2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:35:53.009119 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.009107    2577 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:35:53.009227 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.009218    2577 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:35:53.010369 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.010359    2577 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:35:53.010400 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.010372    2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:35:53.010400 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.010382    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:35:53.010400 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.010392    2577 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:35:53.010519 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.010401    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:35:53.011736 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.011685    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:35:53.014553 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.014519    2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:35:53.018527 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.018514    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:35:53.019594 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.019581    2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:35:53.019638 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.019612    2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:35:53.019766 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.019756    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:35:53.019802 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.019773    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:35:53.019802 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.019780    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:35:53.019802 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.019786    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:35:53.019802 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.019793    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:35:53.019802 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.019800    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:35:53.020645 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.020636    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:35:53.020673 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.020647    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:35:53.020673 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.020655    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:35:53.020673 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.020662    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:35:53.020673 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.020672    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:35:53.020828 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.020682    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:35:53.021303 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.021295    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:35:53.021331 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.021305    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:35:53.025391 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.025380    2577 server.go:1263] "Started kubelet"
Oct 30 20:35:53.025613 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.025520    2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:35:53.025613 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.025515    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:35:53.025716 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.025631    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:35:53.026332 ip-10-0-141-37 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:35:53.026861 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.026738    2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:35:53.028158 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.028144    2577 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:35:53.031247 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.031226    2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 20:35:53.032095 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.032076    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:35:53.032475 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.032457    2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:35:53.032588 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.032564    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-37.us-west-1.compute.internal\" not found"
Oct 30 20:35:53.033325 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033019    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:35:53.033325 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033038    2577 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:35:53.033325 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033100    2577 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:35:53.033325 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033183    2577 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:35:53.033325 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033195    2577 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:35:53.033590 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033365    2577 factory.go:55] Registering systemd factory
Oct 30 20:35:53.033590 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033379    2577 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:35:53.033665 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033646    2577 factory.go:153] Registering CRI-O factory
Oct 30 20:35:53.033706 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033666    2577 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:35:53.033749 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033739    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:35:53.033784 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033756    2577 factory.go:103] Registering Raw factory
Oct 30 20:35:53.033784 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.033769    2577 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:35:53.034899 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.034882    2577 manager.go:319] Starting recovery of all containers
Oct 30 20:35:53.042145 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.042100    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:35:53.049012 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.048994    2577 manager.go:324] Recovery completed
Oct 30 20:35:53.050859 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.050834    2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Oct 30 20:35:53.053635 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.053623    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:53.055384 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.055362    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:53.055429 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.055400    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:53.055429 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.055413    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:53.056057 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.056037    2577 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:35:53.056057 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.056053    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:53.056160 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.056050    2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:35:53.056160 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.056119    2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:35:53.056746 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.056733    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:53.056795 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.056761    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:53.056795 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.056773    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:53.058323 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.058307    2577 policy_none.go:50] "Start"
Oct 30 20:35:53.058390 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.058326    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:35:53.058390 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.058339    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:35:53.060557 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.060528    2577 policy_none.go:44] "Start"
Oct 30 20:35:53.096276 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.096085    2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:35:53.100119 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.100106    2577 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:35:53.100701 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.100688    2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:35:53.100746 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.100703    2577 server.go:87] "Starting device plugin registration server"
Oct 30 20:35:53.100919 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.100908    2577 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:35:53.100961 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.100925    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:35:53.101065 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.101042    2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:35:53.101137 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.101128    2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:35:53.101137 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.101137    2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:35:53.101639 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.101621    2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:35:53.101705 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.101661    2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-37.us-west-1.compute.internal\" not found"
Oct 30 20:35:53.167479 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.167458    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:35:53.169595 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.167482    2577 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:35:53.169595 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.167499    2577 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:35:53.169595 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.167527    2577 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 20:35:53.176934 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.176906    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-37.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 20:35:53.177038 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.176903    2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-37.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 20:35:53.177934 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.176904    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-37.us-west-1.compute.internal.18e3690671e8305b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-37.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-37.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 20:35:53.025351771 +0000 UTC m=+0.382424788,LastTimestamp:2026-10-30 20:35:53.025351771 +0000 UTC m=+0.382424788,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-37.us-west-1.compute.internal,}"
Oct 30 20:35:53.201494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.201444    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:53.202357 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.202330    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:53.202446 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.202365    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:53.202446 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.202378    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:53.202446 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.202403    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.255171 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.255145    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:35:53.255258 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.255186    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6649d"
Oct 30 20:35:53.268213 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.268191    2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"]
Oct 30 20:35:53.268267 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.268248    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:53.269096 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.269080    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:53.269163 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.269106    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:53.269163 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.269117    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:53.271360 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.271349    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:53.271560 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.271528    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.271599 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.271576    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:53.277592 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.277575    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:53.277693 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.277600    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:53.277693 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.277614    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:53.277693 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.277670    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:53.277693 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.277691    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:53.277823 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.277700    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:53.279904 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.279869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.279997 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.279923    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:35:53.280756 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.280739    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:35:53.280843 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.280767    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:35:53.280843 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.280782    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:35:53.318074 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.318054    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-37.us-west-1.compute.internal\" not found" node="ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.320728 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.320709    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-37.us-west-1.compute.internal\" not found" node="ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.335216 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.335195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.335308 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.335223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.335308 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.335240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b6a03677cd7bdfb119e5441f3717b20-config\") pod \"kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"8b6a03677cd7bdfb119e5441f3717b20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.335456 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.335441    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:53.337008 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.336994    2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:53.434588 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.434556    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:53.435798 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.435774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.435898 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.435815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.435898 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.435845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b6a03677cd7bdfb119e5441f3717b20-config\") pod \"kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"8b6a03677cd7bdfb119e5441f3717b20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.435898 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.435873    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.435898 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.435883    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b6a03677cd7bdfb119e5441f3717b20-config\") pod \"kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"8b6a03677cd7bdfb119e5441f3717b20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.436037 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.435883    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.437261 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.437247    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:53.437815 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.437799    2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.437876 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.437825    2577 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-37.us-west-1.compute.internal\": node \"ip-10-0-141-37.us-west-1.compute.internal\" not found"
Oct 30 20:35:53.533361 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.533289    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.596916 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.596889    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:35:53.597052 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.596994    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.620624 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.620603    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.623726 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.623711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:35:53.657958 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.657939    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:35:53.973193 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.973115    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 20:35:53.973672 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.973242    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:35:53.973672 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.973294    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:35:53.973672 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:53.973303    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 30 20:35:53.973672 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:53.973317    2577 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a41523619245140049339d55e6c91ffd-78a63a0feb3ef4fb.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-141-37.us-west-1.compute.internal.18e3690673b2f0c1\": read tcp 10.0.141.37:49560->3.151.105.250:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-141-37.us-west-1.compute.internal.18e3690673b2f0c1  default   5529 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-37.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-37.us-west-1.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-37.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 20:35:53 +0000 UTC,LastTimestamp:2026-10-30 20:35:53.202382256 +0000 UTC m=+0.559455272,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-37.us-west-1.compute.internal,}"
Oct 30 20:35:54.011115 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.011088    2577 apiserver.go:52] "Watching apiserver"
Oct 30 20:35:54.032365 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.032339    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 20:35:54.259772 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.259679    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:30:54 +0000 UTC" deadline="2028-07-08 04:17:58.215054114 +0000 UTC"
Oct 30 20:35:54.259772 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.259724    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14791h42m3.9553334s"
Oct 30 20:35:54.288877 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.288846    2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:35:54.289225 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.289203    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-hhmc8","openshift-network-diagnostics/network-check-target-j7s49","openshift-ovn-kubernetes/ovnkube-node-7tj94","kube-system/konnectivity-agent-qfhrk","openshift-cluster-node-tuning-operator/tuned-4sjbf","openshift-dns/node-resolver-cfhpb","openshift-multus/network-metrics-daemon-jwcss","openshift-network-operator/iptables-alerter-2h449","kube-system/global-pull-secret-syncer-2r44p","kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6","openshift-image-registry/node-ca-f58ms","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal","openshift-multus/multus-additional-cni-plugins-r7zdg"]
Oct 30 20:35:54.291632 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.291612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.293707 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.293690    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:35:54.293803 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.293750    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:35:54.295870 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.295853    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.297935 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.297916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:35:54.299986 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.299970    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.302055 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.302037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.304116 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.304099    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:54.304199 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.304152    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:35:54.306277 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.306261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.308372 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.308357    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.308458 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.308409    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:35:54.310618 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.310598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.313554 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.313527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.315792 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.315778    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.334491 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.334470    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:35:54.340827 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.340810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-netns\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.340915 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.340840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovn-node-metrics-cert\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.340915 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.340866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-system-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.340915 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.340890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-socket-dir-parent\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.341074 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.340972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-daemon-config\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.341074 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341018    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-env-overrides\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.341074 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.341178 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-kubernetes\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.341178 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341126    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bcfa608-6980-494c-9f02-fb3ebeb52f28-hosts-file\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.341178 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341160    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:54.341282 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-dbus\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.341282 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-log-socket\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.341343 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.341343 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341322    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cnibin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.341406 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-lib-modules\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.341406 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.341482 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldmq2\" (UniqueName: \"kubernetes.io/projected/bcb1db90-2d6e-4d26-8289-a05a105a2144-kube-api-access-ldmq2\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.341482 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-var-lib-kubelet\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.341583 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.341583 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:35:54.341583 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-systemd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.341699 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-config\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.341699 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-conf-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.341986 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.341956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-cnibin\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.342258 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.342258 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-netns\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.342388 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342301    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-run\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.342388 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-node-log\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.342485 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-host\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.342485 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-tmp\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.342597 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.342597 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342518    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-slash\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.342597 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qq5k\" (UniqueName: \"kubernetes.io/projected/dfdeb085-46f5-41da-8759-3ec51cf47b90-kube-api-access-2qq5k\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.342776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-host\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.342776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342646    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.342776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-kubelet\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.342776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.342776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcfa608-6980-494c-9f02-fb3ebeb52f28-tmp-dir\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.342776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342771    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-systemd-units\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-script-lib\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-bin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-hostroot\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-modprobe-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-kubelet-config\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcb1db90-2d6e-4d26-8289-a05a105a2144-host-slash\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.342979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzz59\" (UniqueName: \"kubernetes.io/projected/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-kube-api-access-dzz59\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343000    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-multus-certs\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.343031 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-bin\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343091    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjblj\" (UniqueName: \"kubernetes.io/projected/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-kube-api-access-rjblj\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cni-binary-copy\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-systemd\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbtdv\" (UniqueName: \"kubernetes.io/projected/6bcfa608-6980-494c-9f02-fb3ebeb52f28-kube-api-access-lbtdv\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-device-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-kubelet\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343231    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-var-lib-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343319    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-etc-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343339    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcb1db90-2d6e-4d26-8289-a05a105a2144-iptables-alerter-script\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343381    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-conf\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmkfc\" (UniqueName: \"kubernetes.io/projected/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kube-api-access-xmkfc\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.343444 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-netd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-k8s-cni-cncf-io\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb82j\" (UniqueName: \"kubernetes.io/projected/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-kube-api-access-hb82j\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-tuned\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343525    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhtbv\" (UniqueName: \"kubernetes.io/projected/7070a33d-27e6-4500-bf51-7902613dec6a-kube-api-access-lhtbv\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-ovn\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343670    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-serviceca\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82qk6\" (UniqueName: \"kubernetes.io/projected/eec25890-c83c-47df-863f-6959537e5c05-kube-api-access-82qk6\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-etc-kubernetes\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad5deab8-b21e-49be-ba98-36639a81e88d-konnectivity-ca\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343851    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-sys\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-system-cni-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343905    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-multus\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad5deab8-b21e-49be-ba98-36639a81e88d-agent-certs\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:35:54.344604 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.343966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysconfig\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.345518 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.345268    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:35:54.345518 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.345268    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:35:54.345518 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.345290    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:35:54.345518 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.345327    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:35:54.345518 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.345375    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-b4p7g\""
Oct 30 20:35:54.348668 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.348650    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mx55q\""
Oct 30 20:35:54.348811 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.348783    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:35:54.348811 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.348784    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:35:54.348811 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.348798    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:35:54.349030 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.348924    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:35:54.349030 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.348933    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:35:54.349101 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.349066    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:35:54.350550 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.350520    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:35:54.350705 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.350694    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:35:54.350755 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.350740    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-k65fh\""
Oct 30 20:35:54.352644 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.352632    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l8lvp\""
Oct 30 20:35:54.392064 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.392048    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:35:54.392064 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.392051    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:35:54.393260 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.393242    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:35:54.393368 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.393284    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:35:54.395235 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.395223    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hbdn4\""
Oct 30 20:35:54.395357 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.395345    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:35:54.395523 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.395510    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8v9jn\""
Oct 30 20:35:54.396045 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.396031    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2mcfh\""
Oct 30 20:35:54.399295 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399281    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:35:54.399382 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399361    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:35:54.399425 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399409    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k4gm7\""
Oct 30 20:35:54.399670 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399659    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:35:54.399716 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399690    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:35:54.399716 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399703    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pdv7w\""
Oct 30 20:35:54.399791 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399771    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:35:54.399791 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399776    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:35:54.399791 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399781    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:35:54.399925 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399812    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:35:54.399925 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399832    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:35:54.399925 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399854    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 20:35:54.399925 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399902    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:35:54.399925 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.399905    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-txs8k"
Oct 30 20:35:54.444945 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.444918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.444945 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.444947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cni-binary-copy\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.445117 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.444963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-systemd\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.445117 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.444980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtdv\" (UniqueName: \"kubernetes.io/projected/6bcfa608-6980-494c-9f02-fb3ebeb52f28-kube-api-access-lbtdv\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.445117 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.444994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-device-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.445117 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-kubelet\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445117 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-var-lib-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445117 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445069    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-systemd\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.445117 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445069    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445117 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-etc-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445117 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445122    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-device-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445157    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcb1db90-2d6e-4d26-8289-a05a105a2144-iptables-alerter-script\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445138    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-var-lib-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445179    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-etc-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445110    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-kubelet\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-conf\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmkfc\" (UniqueName: \"kubernetes.io/projected/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kube-api-access-xmkfc\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-netd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-k8s-cni-cncf-io\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb82j\" (UniqueName: \"kubernetes.io/projected/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-kube-api-access-hb82j\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445352    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-netd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445369    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-tuned\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445376    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-conf\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhtbv\" (UniqueName: \"kubernetes.io/projected/7070a33d-27e6-4500-bf51-7902613dec6a-kube-api-access-lhtbv\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:54.445586 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445391    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-k8s-cni-cncf-io\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-ovn\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445473    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-serviceca\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445499    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445558    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cni-binary-copy\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445566    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445613    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-ovn\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445666    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcb1db90-2d6e-4d26-8289-a05a105a2144-iptables-alerter-script\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.445750    2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82qk6\" (UniqueName: \"kubernetes.io/projected/eec25890-c83c-47df-863f-6959537e5c05-kube-api-access-82qk6\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-etc-kubernetes\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad5deab8-b21e-49be-ba98-36639a81e88d-konnectivity-ca\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446114    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-serviceca\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-sys\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-system-cni-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446182    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-etc-kubernetes\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-multus\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.446430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446210    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-system-cni-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446215    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-multus\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446187    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-sys\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad5deab8-b21e-49be-ba98-36639a81e88d-agent-certs\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysconfig\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-netns\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovn-node-metrics-cert\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446407    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-system-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-socket-dir-parent\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446435    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysconfig\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-daemon-config\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446451    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-netns\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-env-overrides\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446492    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-socket-dir-parent\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-kubernetes\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bcfa608-6980-494c-9f02-fb3ebeb52f28-hosts-file\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.447294 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446615    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad5deab8-b21e-49be-ba98-36639a81e88d-konnectivity-ca\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-dbus\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-log-socket\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446659    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-kubernetes\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446495    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-system-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cnibin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-lib-modules\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.446739    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldmq2\" (UniqueName: \"kubernetes.io/projected/bcb1db90-2d6e-4d26-8289-a05a105a2144-kube-api-access-ldmq2\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.446796    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs podName:7070a33d-27e6-4500-bf51-7902613dec6a nodeName:}" failed. No retries permitted until 2026-10-30 20:35:54.946777589 +0000 UTC m=+2.303850614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs") pod "network-metrics-daemon-jwcss" (UID: "7070a33d-27e6-4500-bf51-7902613dec6a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-var-lib-kubelet\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-systemd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.448142 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-config\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-conf-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-cnibin\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-netns\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447016    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-dbus\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.446999    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-env-overrides\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447057    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-daemon-config\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447068    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-var-lib-kubelet\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447087    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-log-socket\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447093    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cnibin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447141    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447187    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-lib-modules\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-run\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447219    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-systemd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-node-log\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447227    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447241    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-conf-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.448960 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-host\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-tmp\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447284    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-run\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447284    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-cnibin\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447184    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447327    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-netns\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-slash\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447337    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bcfa608-6980-494c-9f02-fb3ebeb52f28-hosts-file\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447220    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447365    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-slash\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qq5k\" (UniqueName: \"kubernetes.io/projected/dfdeb085-46f5-41da-8759-3ec51cf47b90-kube-api-access-2qq5k\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447393    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-node-log\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447408    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-host\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-host\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447432    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-host\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447463    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.449603 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-kubelet\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447563    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcfa608-6980-494c-9f02-fb3ebeb52f28-tmp-dir\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-systemd-units\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-script-lib\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-bin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-hostroot\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-modprobe-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-kubelet-config\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447790    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-config\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcb1db90-2d6e-4d26-8289-a05a105a2144-host-slash\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz59\" (UniqueName: \"kubernetes.io/projected/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-kube-api-access-dzz59\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-multus-certs\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-bin\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.450223 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjblj\" (UniqueName: \"kubernetes.io/projected/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-kube-api-access-rjblj\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.447839    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-bin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448246    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-hostroot\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448269    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-systemd-units\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448296    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448326    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-modprobe-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448364    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-kubelet-config\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448411    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcb1db90-2d6e-4d26-8289-a05a105a2144-host-slash\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448475    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448479    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcfa608-6980-494c-9f02-fb3ebeb52f28-tmp-dir\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.448627    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448676    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.448688    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret podName:12273a1e-7592-4750-a6e2-58855d489834 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:54.948670631 +0000 UTC m=+2.305743634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret") pod "global-pull-secret-syncer-2r44p" (UID: "12273a1e-7592-4750-a6e2-58855d489834") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448727    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-bin\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448733    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-multus-certs\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448789    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-kubelet\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.448804    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.450738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.449509    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.451224 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.449752    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-tmp\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.451224 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.449788    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-tuned\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.451224 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.449821    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-script-lib\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.451224 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.450841    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovn-node-metrics-cert\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.451504 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.451488    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad5deab8-b21e-49be-ba98-36639a81e88d-agent-certs\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:35:54.506306 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.506280    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:54.506306 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.506309    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:54.506484 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.506323    2577 projected.go:196] Error preparing data for projected volume kube-api-access-gzws7 for pod openshift-network-diagnostics/network-check-target-j7s49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:54.506484 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.506380    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7 podName:c91d68e8-37c6-4a25-8da1-9917f47cdba7 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:55.006362748 +0000 UTC m=+2.363435754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gzws7" (UniqueName: "kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7") pod "network-check-target-j7s49" (UID: "c91d68e8-37c6-4a25-8da1-9917f47cdba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:54.507647 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.507618    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhtbv\" (UniqueName: \"kubernetes.io/projected/7070a33d-27e6-4500-bf51-7902613dec6a-kube-api-access-lhtbv\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:54.507789 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.507767    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtdv\" (UniqueName: \"kubernetes.io/projected/6bcfa608-6980-494c-9f02-fb3ebeb52f28-kube-api-access-lbtdv\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.508137 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.508112    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmkfc\" (UniqueName: \"kubernetes.io/projected/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kube-api-access-xmkfc\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.508387 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.508202    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb82j\" (UniqueName: \"kubernetes.io/projected/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-kube-api-access-hb82j\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.508554 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.508519    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldmq2\" (UniqueName: \"kubernetes.io/projected/bcb1db90-2d6e-4d26-8289-a05a105a2144-kube-api-access-ldmq2\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.508647 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.508628    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82qk6\" (UniqueName: \"kubernetes.io/projected/eec25890-c83c-47df-863f-6959537e5c05-kube-api-access-82qk6\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.509858 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.509803    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qq5k\" (UniqueName: \"kubernetes.io/projected/dfdeb085-46f5-41da-8759-3ec51cf47b90-kube-api-access-2qq5k\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.510208 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.510191    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjblj\" (UniqueName: \"kubernetes.io/projected/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-kube-api-access-rjblj\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.511113 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.511096    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzz59\" (UniqueName: \"kubernetes.io/projected/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-kube-api-access-dzz59\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.627183 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.627142    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhmc8"
Oct 30 20:35:54.659401 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.659373    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:35:54.661515 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.661489    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:35:54.672033 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.672014    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:35:54.681527 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.681507    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:35:54.687993 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.687971    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:35:54.696455 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.696436    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:35:54.723139 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.723119    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:35:54.739576 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.739556    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:35:54.760867 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:54.760806    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6a03677cd7bdfb119e5441f3717b20.slice/crio-16cb19a727c1c3be986f3e18a8262249beb959554bd4af36081fb65ba4424627 WatchSource:0}: Error finding container 16cb19a727c1c3be986f3e18a8262249beb959554bd4af36081fb65ba4424627: Status 404 returned error can't find the container with id 16cb19a727c1c3be986f3e18a8262249beb959554bd4af36081fb65ba4424627
Oct 30 20:35:54.761102 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:54.761084    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c58089_5fe0_4d5b_bd1a_a35fed0fabf8.slice/crio-ecfdfd45ed4274379123a37009a2e79b6b5893230120165e75c58e184e16d818 WatchSource:0}: Error finding container ecfdfd45ed4274379123a37009a2e79b6b5893230120165e75c58e184e16d818: Status 404 returned error can't find the container with id ecfdfd45ed4274379123a37009a2e79b6b5893230120165e75c58e184e16d818
Oct 30 20:35:54.761842 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:54.761822    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec25890_c83c_47df_863f_6959537e5c05.slice/crio-31f6d10f8793f51df1e756087059bc0d418c34cf0bb97ba99003b68f6d429713 WatchSource:0}: Error finding container 31f6d10f8793f51df1e756087059bc0d418c34cf0bb97ba99003b68f6d429713: Status 404 returned error can't find the container with id 31f6d10f8793f51df1e756087059bc0d418c34cf0bb97ba99003b68f6d429713
Oct 30 20:35:54.762714 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:54.762694    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba69adc38a43ac678113498090bd571.slice/crio-8b0071e38686c1662fe21cce2d7cc4371f0fd6fd31136b871fbb8a9c3d637989 WatchSource:0}: Error finding container 8b0071e38686c1662fe21cce2d7cc4371f0fd6fd31136b871fbb8a9c3d637989: Status 404 returned error can't find the container with id 8b0071e38686c1662fe21cce2d7cc4371f0fd6fd31136b871fbb8a9c3d637989
Oct 30 20:35:54.767945 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.767925    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:35:54.952638 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.952599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:54.952828 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:54.952660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:54.952828 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.952757    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:54.952828 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.952757    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:54.952828 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.952810    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret podName:12273a1e-7592-4750-a6e2-58855d489834 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:55.952798143 +0000 UTC m=+3.309871152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret") pod "global-pull-secret-syncer-2r44p" (UID: "12273a1e-7592-4750-a6e2-58855d489834") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:54.952828 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:54.952826    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs podName:7070a33d-27e6-4500-bf51-7902613dec6a nodeName:}" failed. No retries permitted until 2026-10-30 20:35:55.952818757 +0000 UTC m=+3.309891764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs") pod "network-metrics-daemon-jwcss" (UID: "7070a33d-27e6-4500-bf51-7902613dec6a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:55.053849 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.053760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:35:55.054394 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:55.053928    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:55.054394 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:55.053949    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:55.054394 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:55.053960    2577 projected.go:196] Error preparing data for projected volume kube-api-access-gzws7 for pod openshift-network-diagnostics/network-check-target-j7s49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:55.054394 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:55.054014    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7 podName:c91d68e8-37c6-4a25-8da1-9917f47cdba7 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:56.053999595 +0000 UTC m=+3.411072614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzws7" (UniqueName: "kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7") pod "network-check-target-j7s49" (UID: "c91d68e8-37c6-4a25-8da1-9917f47cdba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:55.117768 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.117730    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:55.172485 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.172437    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" event={"ID":"eec25890-c83c-47df-863f-6959537e5c05","Type":"ContainerStarted","Data":"31f6d10f8793f51df1e756087059bc0d418c34cf0bb97ba99003b68f6d429713"}
Oct 30 20:35:55.173680 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.173655    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f58ms" event={"ID":"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8","Type":"ContainerStarted","Data":"ecfdfd45ed4274379123a37009a2e79b6b5893230120165e75c58e184e16d818"}
Oct 30 20:35:55.174800 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.174781    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"0ba69adc38a43ac678113498090bd571","Type":"ContainerStarted","Data":"8b0071e38686c1662fe21cce2d7cc4371f0fd6fd31136b871fbb8a9c3d637989"}
Oct 30 20:35:55.175800 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.175781    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"8b6a03677cd7bdfb119e5441f3717b20","Type":"ContainerStarted","Data":"16cb19a727c1c3be986f3e18a8262249beb959554bd4af36081fb65ba4424627"}
Oct 30 20:35:55.303417 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.303377    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:55.402681 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.402569    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:30:55 +0000 UTC" deadline="2028-04-20 23:38:55.057517073 +0000 UTC"
Oct 30 20:35:55.402681 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.402615    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12915h2m59.654906543s"
Oct 30 20:35:55.449681 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.449646    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:35:55.501578 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:55.501547    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d5ffb9_a652_4d8f_89f5_9c4657fa3341.slice/crio-e56ca3e6ec65a65c84d9b04f11ba180b57a73d29d6a386bc3d552d908989d6f3 WatchSource:0}: Error finding container e56ca3e6ec65a65c84d9b04f11ba180b57a73d29d6a386bc3d552d908989d6f3: Status 404 returned error can't find the container with id e56ca3e6ec65a65c84d9b04f11ba180b57a73d29d6a386bc3d552d908989d6f3
Oct 30 20:35:55.536901 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:55.536876    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad5deab8_b21e_49be_ba98_36639a81e88d.slice/crio-c7b1e837e336dcc848ef35a2964562c55682a198167807ddacc58004f22cde4a WatchSource:0}: Error finding container c7b1e837e336dcc848ef35a2964562c55682a198167807ddacc58004f22cde4a: Status 404 returned error can't find the container with id c7b1e837e336dcc848ef35a2964562c55682a198167807ddacc58004f22cde4a
Oct 30 20:35:55.547094 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:55.547070    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfdeb085_46f5_41da_8759_3ec51cf47b90.slice/crio-f1423826de9f5bc3ad8722e7a779d6cda553c83a8e05832d82e132f2f2b5865f WatchSource:0}: Error finding container f1423826de9f5bc3ad8722e7a779d6cda553c83a8e05832d82e132f2f2b5865f: Status 404 returned error can't find the container with id f1423826de9f5bc3ad8722e7a779d6cda553c83a8e05832d82e132f2f2b5865f
Oct 30 20:35:55.571394 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:55.571371    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b8956c_da77_4dbd_b8d4_4d3b31c487a5.slice/crio-4f083509ea6433e60550a5c7b4d2c004f1600ae73d65d4bb7699e69f54935925 WatchSource:0}: Error finding container 4f083509ea6433e60550a5c7b4d2c004f1600ae73d65d4bb7699e69f54935925: Status 404 returned error can't find the container with id 4f083509ea6433e60550a5c7b4d2c004f1600ae73d65d4bb7699e69f54935925
Oct 30 20:35:55.592862 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:55.592834    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb1db90_2d6e_4d26_8289_a05a105a2144.slice/crio-1ac6bb8422d4b689d837c90fffa6e9682bf2216158db194f52f965de06987ce8 WatchSource:0}: Error finding container 1ac6bb8422d4b689d837c90fffa6e9682bf2216158db194f52f965de06987ce8: Status 404 returned error can't find the container with id 1ac6bb8422d4b689d837c90fffa6e9682bf2216158db194f52f965de06987ce8
Oct 30 20:35:55.621518 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:55.621493    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bcfa608_6980_494c_9f02_fb3ebeb52f28.slice/crio-d1d1c31d6caebe147ff1a102fc878ee5217fd6ea9465ce96676d9138c5d18fda WatchSource:0}: Error finding container d1d1c31d6caebe147ff1a102fc878ee5217fd6ea9465ce96676d9138c5d18fda: Status 404 returned error can't find the container with id d1d1c31d6caebe147ff1a102fc878ee5217fd6ea9465ce96676d9138c5d18fda
Oct 30 20:35:55.631265 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:35:55.631242    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd39a2f_5ae7_4d35_b616_efe9eee803b9.slice/crio-673d97b5a582ad4436152ba1940237f50f47c7ed11ae123b276421381675f07b WatchSource:0}: Error finding container 673d97b5a582ad4436152ba1940237f50f47c7ed11ae123b276421381675f07b: Status 404 returned error can't find the container with id 673d97b5a582ad4436152ba1940237f50f47c7ed11ae123b276421381675f07b
Oct 30 20:35:55.962610 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.962260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:55.962610 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:55.962346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:55.962610 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:55.962448    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:55.962610 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:55.962507    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:55.962610 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:55.962529    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs podName:7070a33d-27e6-4500-bf51-7902613dec6a nodeName:}" failed. No retries permitted until 2026-10-30 20:35:57.962507543 +0000 UTC m=+5.319580554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs") pod "network-metrics-daemon-jwcss" (UID: "7070a33d-27e6-4500-bf51-7902613dec6a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:55.962610 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:55.962565    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret podName:12273a1e-7592-4750-a6e2-58855d489834 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:57.962547613 +0000 UTC m=+5.319620635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret") pod "global-pull-secret-syncer-2r44p" (UID: "12273a1e-7592-4750-a6e2-58855d489834") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:56.063562 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.063226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:35:56.063562 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:56.063432    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:56.063562 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:56.063452    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:56.063562 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:56.063466    2577 projected.go:196] Error preparing data for projected volume kube-api-access-gzws7 for pod openshift-network-diagnostics/network-check-target-j7s49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:56.063562 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:56.063525    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7 podName:c91d68e8-37c6-4a25-8da1-9917f47cdba7 nodeName:}" failed. No retries permitted until 2026-10-30 20:35:58.063506957 +0000 UTC m=+5.420579968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzws7" (UniqueName: "kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7") pod "network-check-target-j7s49" (UID: "c91d68e8-37c6-4a25-8da1-9917f47cdba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:56.167858 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.167821    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:35:56.168054 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:56.167967    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:35:56.168121 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.168054    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:56.168181 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:56.168141    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:35:56.168240 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.168197    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:56.168292 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:56.168270    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:35:56.182718 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.182681    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhmc8" event={"ID":"01d5ffb9-a652-4d8f-89f5-9c4657fa3341","Type":"ContainerStarted","Data":"e56ca3e6ec65a65c84d9b04f11ba180b57a73d29d6a386bc3d552d908989d6f3"}
Oct 30 20:35:56.184454 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.184424    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cfhpb" event={"ID":"6bcfa608-6980-494c-9f02-fb3ebeb52f28","Type":"ContainerStarted","Data":"d1d1c31d6caebe147ff1a102fc878ee5217fd6ea9465ce96676d9138c5d18fda"}
Oct 30 20:35:56.186264 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.186238    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4sjbf" event={"ID":"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5","Type":"ContainerStarted","Data":"4f083509ea6433e60550a5c7b4d2c004f1600ae73d65d4bb7699e69f54935925"}
Oct 30 20:35:56.187797 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.187774    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qfhrk" event={"ID":"ad5deab8-b21e-49be-ba98-36639a81e88d","Type":"ContainerStarted","Data":"c7b1e837e336dcc848ef35a2964562c55682a198167807ddacc58004f22cde4a"}
Oct 30 20:35:56.189315 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.189240    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6" event={"ID":"6dd39a2f-5ae7-4d35-b616-efe9eee803b9","Type":"ContainerStarted","Data":"673d97b5a582ad4436152ba1940237f50f47c7ed11ae123b276421381675f07b"}
Oct 30 20:35:56.190836 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.190810    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2h449" event={"ID":"bcb1db90-2d6e-4d26-8289-a05a105a2144","Type":"ContainerStarted","Data":"1ac6bb8422d4b689d837c90fffa6e9682bf2216158db194f52f965de06987ce8"}
Oct 30 20:35:56.193391 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.193282    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" event={"ID":"dfdeb085-46f5-41da-8759-3ec51cf47b90","Type":"ContainerStarted","Data":"f1423826de9f5bc3ad8722e7a779d6cda553c83a8e05832d82e132f2f2b5865f"}
Oct 30 20:35:56.403861 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.403624    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:30:55 +0000 UTC" deadline="2028-05-11 22:18:42.038403616 +0000 UTC"
Oct 30 20:35:56.403861 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:56.403799    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13417h42m45.634610202s"
Oct 30 20:35:57.997283 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:57.996842    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:57.997283 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:57.996924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:57.997283 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:57.997072    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:57.997283 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:57.997137    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs podName:7070a33d-27e6-4500-bf51-7902613dec6a nodeName:}" failed. No retries permitted until 2026-10-30 20:36:01.997119096 +0000 UTC m=+9.354192105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs") pod "network-metrics-daemon-jwcss" (UID: "7070a33d-27e6-4500-bf51-7902613dec6a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:35:57.997283 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:57.997205    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:57.997283 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:57.997241    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret podName:12273a1e-7592-4750-a6e2-58855d489834 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:01.997229756 +0000 UTC m=+9.354302766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret") pod "global-pull-secret-syncer-2r44p" (UID: "12273a1e-7592-4750-a6e2-58855d489834") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:35:58.098127 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:58.097712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:35:58.098127 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:58.097945    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:35:58.098127 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:58.097968    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:35:58.098127 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:58.097982    2577 projected.go:196] Error preparing data for projected volume kube-api-access-gzws7 for pod openshift-network-diagnostics/network-check-target-j7s49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:58.098127 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:58.098049    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7 podName:c91d68e8-37c6-4a25-8da1-9917f47cdba7 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:02.098028558 +0000 UTC m=+9.455101580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzws7" (UniqueName: "kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7") pod "network-check-target-j7s49" (UID: "c91d68e8-37c6-4a25-8da1-9917f47cdba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:35:58.169199 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:58.168785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:35:58.169199 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:58.168921    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:35:58.169199 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:58.168990    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:35:58.169199 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:58.169047    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:35:58.169199 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:58.169088    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:35:58.169199 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:35:58.169132    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:35:58.222734 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:58.222484    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" event={"ID":"eec25890-c83c-47df-863f-6959537e5c05","Type":"ContainerStarted","Data":"8b9d07379728f3ddf19a96613fe3e4727e6ed3e51e9579aa6c1b1a9e9f08578f"}
Oct 30 20:35:59.242261 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:59.242224    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"8b6a03677cd7bdfb119e5441f3717b20","Type":"ContainerStarted","Data":"2f5305659305bafed27ffd596a3a0588db486ed8ac4c2a0b760839a2c09ba77b"}
Oct 30 20:35:59.249098 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:59.249068    2577 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="8b9d07379728f3ddf19a96613fe3e4727e6ed3e51e9579aa6c1b1a9e9f08578f" exitCode=0
Oct 30 20:35:59.249206 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:59.249163    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" event={"ID":"eec25890-c83c-47df-863f-6959537e5c05","Type":"ContainerDied","Data":"8b9d07379728f3ddf19a96613fe3e4727e6ed3e51e9579aa6c1b1a9e9f08578f"}
Oct 30 20:35:59.507494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:35:59.507342    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal" podStartSLOduration=5.507321611 podStartE2EDuration="5.507321611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:35:59.369437885 +0000 UTC m=+6.726510916" watchObservedRunningTime="2026-10-30 20:35:59.507321611 +0000 UTC m=+6.864394644"
Oct 30 20:36:00.168549 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:00.168493    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:00.168757 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:00.168730    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:00.168908 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:00.168857    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:00.168987 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:00.168962    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:00.169055 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:00.169047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:00.169198 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:00.169173    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:00.263733 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:00.263699    2577 generic.go:356] "Generic (PLEG): container finished" podID="0ba69adc38a43ac678113498090bd571" containerID="6aa9f6d8bc00744db029461666a045f728737520e9fa42677084eeef2548c79f" exitCode=0
Oct 30 20:36:00.264789 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:00.264762    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"0ba69adc38a43ac678113498090bd571","Type":"ContainerDied","Data":"6aa9f6d8bc00744db029461666a045f728737520e9fa42677084eeef2548c79f"}
Oct 30 20:36:01.272054 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:01.272003    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"0ba69adc38a43ac678113498090bd571","Type":"ContainerStarted","Data":"451271da1f9444d7c87e4b4c1384833e96247e74f7f2c18af55bf17c727bdac7"}
Oct 30 20:36:01.277376 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:01.277344    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qfhrk" event={"ID":"ad5deab8-b21e-49be-ba98-36639a81e88d","Type":"ContainerStarted","Data":"67ec92b9fe19d3599a9bba090c00228047450c61b553fc415b513465faa1765e"}
Oct 30 20:36:01.282191 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:01.282163    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f58ms" event={"ID":"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8","Type":"ContainerStarted","Data":"a28e6a8e19aa9375fce72c3aafc1b36a56cee642a918bb59145a8c9c04fc8364"}
Oct 30 20:36:01.528594 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:01.528467    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal" podStartSLOduration=7.528446773 podStartE2EDuration="7.528446773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:01.40139399 +0000 UTC m=+8.758467088" watchObservedRunningTime="2026-10-30 20:36:01.528446773 +0000 UTC m=+8.885519799"
Oct 30 20:36:01.529063 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:01.529021    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qfhrk" podStartSLOduration=2.7402407970000002 podStartE2EDuration="7.529007856s" totalImagesPullingTime="4.788767059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:01.527976025 +0000 UTC m=+8.885049054" watchObservedRunningTime="2026-10-30 20:36:01.529007856 +0000 UTC m=+8.886080887"
Oct 30 20:36:02.032445 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:02.032404    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:02.032658 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:02.032489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:02.032738 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.032665    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:36:02.032738 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.032709    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:36:02.032851 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.032747    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs podName:7070a33d-27e6-4500-bf51-7902613dec6a nodeName:}" failed. No retries permitted until 2026-10-30 20:36:10.03272306 +0000 UTC m=+17.389796089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs") pod "network-metrics-daemon-jwcss" (UID: "7070a33d-27e6-4500-bf51-7902613dec6a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:36:02.032851 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.032780    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret podName:12273a1e-7592-4750-a6e2-58855d489834 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:10.03275919 +0000 UTC m=+17.389832212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret") pod "global-pull-secret-syncer-2r44p" (UID: "12273a1e-7592-4750-a6e2-58855d489834") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:36:02.132944 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:02.132901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:02.133133 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.133098    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:36:02.133133 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.133122    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:36:02.133133 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.133135    2577 projected.go:196] Error preparing data for projected volume kube-api-access-gzws7 for pod openshift-network-diagnostics/network-check-target-j7s49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:36:02.133301 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.133195    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7 podName:c91d68e8-37c6-4a25-8da1-9917f47cdba7 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:10.133176135 +0000 UTC m=+17.490249143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzws7" (UniqueName: "kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7") pod "network-check-target-j7s49" (UID: "c91d68e8-37c6-4a25-8da1-9917f47cdba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:36:02.168400 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:02.168332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:02.168547 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.168487    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:02.168600 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:02.168537    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:02.168662 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.168614    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:02.168709 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:02.168690    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:02.168764 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:02.168746    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:03.298432 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:03.298385    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6" event={"ID":"6dd39a2f-5ae7-4d35-b616-efe9eee803b9","Type":"ContainerStarted","Data":"44035bdd349695e9c22865a1a5f470571a943a3ab15438bb51411a3a993eeb71"}
Oct 30 20:36:03.533097 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:03.532488    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:36:03.533556 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:03.533401    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:36:03.660028 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:03.659935    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f58ms" podStartSLOduration=4.177626808 podStartE2EDuration="9.659921165s" totalImagesPullingTime="5.482294357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:01.653740039 +0000 UTC m=+9.010813072" watchObservedRunningTime="2026-10-30 20:36:03.659921165 +0000 UTC m=+11.016994241"
Oct 30 20:36:04.168329 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:04.168277    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:04.168501 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:04.168409    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:04.168872 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:04.168852    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:04.168994 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:04.168971    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:04.169055 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:04.169033    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:04.169128 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:04.169108    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:04.780796 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:04.780766    2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:36:05.107682 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.107489    2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:36:04.780789937Z","UUID":"aa8e24a5-7623-4943-a429-024b13ec204a","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:36:05.109382 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.109357    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:36:05.109530 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.109392    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:36:05.306833 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.306366    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cfhpb" event={"ID":"6bcfa608-6980-494c-9f02-fb3ebeb52f28","Type":"ContainerStarted","Data":"a648057675bb6c1696416d5f8f13a9393157386b91c04c3f7f4c5596422298e3"}
Oct 30 20:36:05.309620 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.309589    2577 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="c78103952178d405e42a77eb88fded3bdbba2df9e486cfdf203bda5575f1747d" exitCode=0
Oct 30 20:36:05.309921 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.309890    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" event={"ID":"eec25890-c83c-47df-863f-6959537e5c05","Type":"ContainerDied","Data":"c78103952178d405e42a77eb88fded3bdbba2df9e486cfdf203bda5575f1747d"}
Oct 30 20:36:05.313177 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.313150    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6" event={"ID":"6dd39a2f-5ae7-4d35-b616-efe9eee803b9","Type":"ContainerStarted","Data":"0450aa084bb9d6018adb799b51664de62f7feb6bf28f5d3b2dc8d69fffecdfe1"}
Oct 30 20:36:05.315500 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.315458    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhmc8" event={"ID":"01d5ffb9-a652-4d8f-89f5-9c4657fa3341","Type":"ContainerStarted","Data":"e0c6d67c8162641cdcd83a59b046b26bbd719066580329d3a5639b615e7ad11d"}
Oct 30 20:36:05.563724 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.563451    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-cfhpb" podStartSLOduration=2.626628486 podStartE2EDuration="11.563434102s" totalImagesPullingTime="8.936805616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:05.433208251 +0000 UTC m=+12.790281279" watchObservedRunningTime="2026-10-30 20:36:05.563434102 +0000 UTC m=+12.920507111"
Oct 30 20:36:05.564175 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:05.564141    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-hhmc8" podStartSLOduration=2.758376077 podStartE2EDuration="11.564132111s" totalImagesPullingTime="8.805756034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:05.563771783 +0000 UTC m=+12.920844806" watchObservedRunningTime="2026-10-30 20:36:05.564132111 +0000 UTC m=+12.921205142"
Oct 30 20:36:06.168691 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:06.168652    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:06.169248 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:06.168800    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:06.169248 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:06.169216    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:06.169382 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:06.169314    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:06.169439 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:06.169382    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:06.169496 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:06.169469    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:07.321519 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:07.321479    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4sjbf" event={"ID":"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5","Type":"ContainerStarted","Data":"eb697a92d3128f97cda5aedef2fefad66fe5d83c037cdcff4d1d176987e752d1"}
Oct 30 20:36:07.323907 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:07.323877    2577 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="892358ac4b62093c1beb09b3e291ab1b82a1657fbb55db50a59495dbe8c483c6" exitCode=0
Oct 30 20:36:07.324033 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:07.323925    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" event={"ID":"eec25890-c83c-47df-863f-6959537e5c05","Type":"ContainerDied","Data":"892358ac4b62093c1beb09b3e291ab1b82a1657fbb55db50a59495dbe8c483c6"}
Oct 30 20:36:07.326494 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:07.326470    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6" event={"ID":"6dd39a2f-5ae7-4d35-b616-efe9eee803b9","Type":"ContainerStarted","Data":"8deb3ecac4e9816b0f643571797caf9ecaca5ba7121595e25ae15dd8ec95e269"}
Oct 30 20:36:07.328147 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:07.328124    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2h449" event={"ID":"bcb1db90-2d6e-4d26-8289-a05a105a2144","Type":"ContainerStarted","Data":"59ac5172cb8ba7334087491875ae201bce27b10bda987cb58138b9abc5407a76"}
Oct 30 20:36:07.441596 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:07.441525    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4sjbf" podStartSLOduration=2.206002854 podStartE2EDuration="13.441511741s" totalImagesPullingTime="11.235508887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:07.44093966 +0000 UTC m=+14.798012814" watchObservedRunningTime="2026-10-30 20:36:07.441511741 +0000 UTC m=+14.798584766"
Oct 30 20:36:07.684274 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:07.684174    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2h449" podStartSLOduration=4.541859808 podStartE2EDuration="13.684157027s" totalImagesPullingTime="9.142297219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:07.683304432 +0000 UTC m=+15.040377470" watchObservedRunningTime="2026-10-30 20:36:07.684157027 +0000 UTC m=+15.041230053"
Oct 30 20:36:07.803169 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:07.803120    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6" podStartSLOduration=3.500266776 podStartE2EDuration="13.803105435s" totalImagesPullingTime="10.302838659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:07.803069137 +0000 UTC m=+15.160142163" watchObservedRunningTime="2026-10-30 20:36:07.803105435 +0000 UTC m=+15.160178459"
Oct 30 20:36:08.168755 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:08.168584    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:08.168755 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:08.168602    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:08.168755 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:08.168723    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:08.168977 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:08.168765    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:08.168977 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:08.168854    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:08.168977 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:08.168924    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:09.334974 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:09.334931    2577 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="4e777f852b34fbd7c2ed25519600027e6e0e47f05c5954bad7f85a67b7231863" exitCode=0
Oct 30 20:36:09.335810 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:09.335004    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" event={"ID":"eec25890-c83c-47df-863f-6959537e5c05","Type":"ContainerDied","Data":"4e777f852b34fbd7c2ed25519600027e6e0e47f05c5954bad7f85a67b7231863"}
Oct 30 20:36:10.099637 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:10.099593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:10.099822 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:10.099662    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:10.099822 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.099771    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:36:10.099822 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.099818    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs podName:7070a33d-27e6-4500-bf51-7902613dec6a nodeName:}" failed. No retries permitted until 2026-10-30 20:36:26.099805012 +0000 UTC m=+33.456878016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs") pod "network-metrics-daemon-jwcss" (UID: "7070a33d-27e6-4500-bf51-7902613dec6a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:36:10.100065 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.100037    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:36:10.100207 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.100101    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret podName:12273a1e-7592-4750-a6e2-58855d489834 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:26.100084777 +0000 UTC m=+33.457157794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret") pod "global-pull-secret-syncer-2r44p" (UID: "12273a1e-7592-4750-a6e2-58855d489834") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:36:10.168207 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:10.168168    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:10.168207 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:10.168200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:10.168207 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:10.168169    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:10.168494 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.168310    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:10.168494 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.168386    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:10.168591 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.168483    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:10.200401 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:10.200362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:10.200581 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.200526    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:36:10.200581 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.200569    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:36:10.200581 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.200580    2577 projected.go:196] Error preparing data for projected volume kube-api-access-gzws7 for pod openshift-network-diagnostics/network-check-target-j7s49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:36:10.200714 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:10.200641    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7 podName:c91d68e8-37c6-4a25-8da1-9917f47cdba7 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:26.200621971 +0000 UTC m=+33.557694987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzws7" (UniqueName: "kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7") pod "network-check-target-j7s49" (UID: "c91d68e8-37c6-4a25-8da1-9917f47cdba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:36:11.342734 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:11.342557    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" event={"ID":"dfdeb085-46f5-41da-8759-3ec51cf47b90","Type":"ContainerStarted","Data":"ae41b178e43c943bf307de245141e1301849aa2111ac6989565cc2d5e6e468dc"}
Oct 30 20:36:11.343130 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:11.342771    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" event={"ID":"dfdeb085-46f5-41da-8759-3ec51cf47b90","Type":"ContainerStarted","Data":"a3a0089896ff08d8365e2844233167814f4f3adce1d31dc2b6b816dcb7640a23"}
Oct 30 20:36:11.343130 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:11.342802    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" event={"ID":"dfdeb085-46f5-41da-8759-3ec51cf47b90","Type":"ContainerStarted","Data":"6e2abae19884c687c055ad21393efce9e6605724eaab391b1f1095f5442b85a1"}
Oct 30 20:36:11.343130 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:11.342831    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" event={"ID":"dfdeb085-46f5-41da-8759-3ec51cf47b90","Type":"ContainerStarted","Data":"dae44812929af871ed8765f702c69553ba51731e3edc28ca2ad2b686fdcaba05"}
Oct 30 20:36:11.343130 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:11.342858    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" event={"ID":"dfdeb085-46f5-41da-8759-3ec51cf47b90","Type":"ContainerStarted","Data":"a271be7efbcfefc2d0f825f1ab5973eadc3c82e6c182998697921d12f92a9c79"}
Oct 30 20:36:11.343130 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:11.342885    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" event={"ID":"dfdeb085-46f5-41da-8759-3ec51cf47b90","Type":"ContainerStarted","Data":"7886de5a114d542a4516d856526010307b71b0b80afcbb4a735eaaa8d75c826a"}
Oct 30 20:36:12.168842 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:12.168665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:12.169007 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:12.168687    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:12.169007 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:12.168947    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:12.169007 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:12.168718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:12.169007 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:12.168989    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:12.169211 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:12.169059    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:12.347585 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:12.347531    2577 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="66d301d5a897d288e54de42ab02015b3d7b8ee9d940e096ef05e24878bf5e553" exitCode=0
Oct 30 20:36:12.347952 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:12.347609    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" event={"ID":"eec25890-c83c-47df-863f-6959537e5c05","Type":"ContainerDied","Data":"66d301d5a897d288e54de42ab02015b3d7b8ee9d940e096ef05e24878bf5e553"}
Oct 30 20:36:13.352312 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:13.352283    2577 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="b9e414cb9145d115348917cb934ac26fab5cd8145463cc87957d9196fde7b18a" exitCode=0
Oct 30 20:36:13.352695 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:13.352320    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" event={"ID":"eec25890-c83c-47df-863f-6959537e5c05","Type":"ContainerDied","Data":"b9e414cb9145d115348917cb934ac26fab5cd8145463cc87957d9196fde7b18a"}
Oct 30 20:36:13.637488 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:13.637426    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cfhpb_6bcfa608-6980-494c-9f02-fb3ebeb52f28/dns-node-resolver/0.log"
Oct 30 20:36:14.168650 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:14.168621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:14.168801 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:14.168648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:14.168801 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:14.168662    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:14.168801 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:14.168754    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:14.168918 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:14.168870    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:14.168957 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:14.168935    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:14.358023 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:14.357989    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" event={"ID":"dfdeb085-46f5-41da-8759-3ec51cf47b90","Type":"ContainerStarted","Data":"558e8dc294baf8e40dd0dd0eb87ae7d13a6fb7ea77beef6bde101c2fb9667149"}
Oct 30 20:36:14.361178 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:14.361147    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" event={"ID":"eec25890-c83c-47df-863f-6959537e5c05","Type":"ContainerStarted","Data":"984be9893841bc82c246676009864f372de4b5a7fd167d4ef761fa2a0173ebf6"}
Oct 30 20:36:14.453217 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:14.453149    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f58ms_35c58089-5fe0-4d5b-bd1a-a35fed0fabf8/node-ca/0.log"
Oct 30 20:36:14.484822 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:14.484770    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r7zdg" podStartSLOduration=7.951579495 podStartE2EDuration="20.484757452s" totalImagesPullingTime="12.533177957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:14.484618047 +0000 UTC m=+21.841691069" watchObservedRunningTime="2026-10-30 20:36:14.484757452 +0000 UTC m=+21.841830477"
Oct 30 20:36:16.168340 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:16.168308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:16.168970 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:16.168383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:16.168970 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:16.168470    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:16.168970 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:16.168468    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:16.168970 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:16.168570    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:16.168970 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:16.168618    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:16.368337 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:16.368303    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" event={"ID":"dfdeb085-46f5-41da-8759-3ec51cf47b90","Type":"ContainerStarted","Data":"b3e2496715cfc01ce7f18f7782bc0e122245635ee23945ce57dc57ec508cc99c"}
Oct 30 20:36:16.368602 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:16.368573    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:36:16.368777 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:16.368646    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:36:16.384890 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:16.384868    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:36:16.651354 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:16.651241    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94" podStartSLOduration=7.357427277 podStartE2EDuration="22.651228008s" totalImagesPullingTime="15.293800731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:16.600209377 +0000 UTC m=+23.957282401" watchObservedRunningTime="2026-10-30 20:36:16.651228008 +0000 UTC m=+24.008301062"
Oct 30 20:36:17.371259 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:17.371230    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:36:17.386430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:17.386408    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:36:18.168313 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:18.168278    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:18.168487 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:18.168318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:18.168487 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:18.168397    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:18.168487 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:18.168458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:18.168683 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:18.168561    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:18.168683 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:18.168587    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:20.168731 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:20.168500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:20.169131 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:20.168561    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:20.169131 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:20.168825    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:20.169131 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:20.168869    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:20.169131 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:20.168579    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:20.169131 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:20.168969    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:21.367525 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:21.367489    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:36:21.368007 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:21.367628    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:36:21.368153 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:21.368124    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:36:22.168416 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:22.168380    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:22.168621 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:22.168455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:22.168621 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:22.168549    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:22.168621 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:22.168576    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:22.168756 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:22.168640    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:22.168756 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:22.168718    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:24.167757 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:24.167721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:24.168197 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:24.167790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:24.168197 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:24.167817    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:24.168197 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:24.167905    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:24.168197 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:24.167971    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:24.168197 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:24.168001    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:26.109721 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:26.109669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:26.109721 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:26.109731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:26.110237 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.109825    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:36:26.110237 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.109839    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 20:36:26.110237 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.109876    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs podName:7070a33d-27e6-4500-bf51-7902613dec6a nodeName:}" failed. No retries permitted until 2026-10-30 20:36:58.109863797 +0000 UTC m=+65.466936800 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs") pod "network-metrics-daemon-jwcss" (UID: "7070a33d-27e6-4500-bf51-7902613dec6a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 20:36:26.110237 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.109910    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret podName:12273a1e-7592-4750-a6e2-58855d489834 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:58.109888505 +0000 UTC m=+65.466961522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret") pod "global-pull-secret-syncer-2r44p" (UID: "12273a1e-7592-4750-a6e2-58855d489834") : object "kube-system"/"original-pull-secret" not registered
Oct 30 20:36:26.168391 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:26.168352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:26.168579 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:26.168355    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:26.168579 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.168452    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:26.168579 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:26.168362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:26.168579 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.168502    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:26.168749 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.168629    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:26.210664 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:26.210633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:26.210773 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.210758    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 20:36:26.210808 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.210782    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 20:36:26.210808 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.210792    2577 projected.go:196] Error preparing data for projected volume kube-api-access-gzws7 for pod openshift-network-diagnostics/network-check-target-j7s49: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:36:26.210875 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:26.210836    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7 podName:c91d68e8-37c6-4a25-8da1-9917f47cdba7 nodeName:}" failed. No retries permitted until 2026-10-30 20:36:58.210825009 +0000 UTC m=+65.567898012 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzws7" (UniqueName: "kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7") pod "network-check-target-j7s49" (UID: "c91d68e8-37c6-4a25-8da1-9917f47cdba7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 20:36:28.168623 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:28.168581    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:28.169213 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:28.168635    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:28.169213 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:28.168589    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:28.169213 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:28.168721    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:28.169213 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:28.168785    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:28.169213 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:28.168854    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:30.167738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:30.167688    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:30.167738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:30.167716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:30.168192 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:30.167799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:30.168192 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:30.167803    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:30.168192 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:30.167871    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:30.168192 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:30.167933    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:32.168445 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:32.168408    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:32.168445 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:32.168432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:32.168922 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:32.168408    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:32.168922 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:32.168501    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:32.168922 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:32.168609    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:32.168922 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:32.168678    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:34.167729 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:34.167689    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:34.168116 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:34.167771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:34.168116 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:34.167859    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:34.168116 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:34.167869    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:34.168116 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:34.167965    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:34.168116 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:34.168027    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:35.371919 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:35.371894    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2r44p"]
Oct 30 20:36:35.372416 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:35.372024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:35.372416 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:35.372142    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:35.375716 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:35.375680    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j7s49"]
Oct 30 20:36:35.375977 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:35.375947    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:35.376086 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:35.376061    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:35.376495 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:35.376460    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jwcss"]
Oct 30 20:36:35.376617 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:35.376572    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:35.376701 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:35.376674    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:37.171459 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:37.171423    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:37.171892 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:37.171492    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:37.171892 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:37.171518    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:37.171892 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:37.171612    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:37.171892 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:37.171678    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:37.171892 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:37.171723    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:39.171595 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:39.171348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:39.172091 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:39.171406    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:39.172091 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:39.171681    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j7s49" podUID="c91d68e8-37c6-4a25-8da1-9917f47cdba7"
Oct 30 20:36:39.172091 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:39.171417    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:39.172091 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:39.171737    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jwcss" podUID="7070a33d-27e6-4500-bf51-7902613dec6a"
Oct 30 20:36:39.172091 ip-10-0-141-37 kubenswrapper[2577]: E1030 20:36:39.171812    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2r44p" podUID="12273a1e-7592-4750-a6e2-58855d489834"
Oct 30 20:36:40.379994 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.379922    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeReady"
Oct 30 20:36:40.380340 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.380050    2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 20:36:40.537658 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.537619    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xrcmf"]
Oct 30 20:36:40.557460 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.557422    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2sj2r"]
Oct 30 20:36:40.557666 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.557582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.569765 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.569738    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-42h66"]
Oct 30 20:36:40.569870 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.569848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:36:40.588249 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.588224    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.609717 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.609693    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2sj2r"]
Oct 30 20:36:40.612784 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.612748    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xrcmf"]
Oct 30 20:36:40.613332 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.613304    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pwzv\""
Oct 30 20:36:40.613443 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.613420    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:36:40.613560 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.613528    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:36:40.622992 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.622971    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:36:40.623205 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.623193    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:36:40.623244 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.623215    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-2nx5p\""
Oct 30 20:36:40.627459 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.627446    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:36:40.641895 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.641846    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:36:40.659795 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.659775    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:36:40.659795 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.659777    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:36:40.659953 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.659825    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:36:40.662336 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.662319    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mk8vz\""
Oct 30 20:36:40.676143 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.676124    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-42h66"]
Oct 30 20:36:40.706780 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.706740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-tmp-dir\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.706780 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.706779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b353680-167d-4d3e-aa95-2ddbd90d7566-data-volume\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.706989 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.706802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b353680-167d-4d3e-aa95-2ddbd90d7566-crio-socket\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.706989 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.706903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.706989 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.706961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc63aebd-9b64-45a5-970c-d07427cb4654-cert\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:36:40.706989 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.706987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58nsn\" (UniqueName: \"kubernetes.io/projected/fc63aebd-9b64-45a5-970c-d07427cb4654-kube-api-access-58nsn\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:36:40.707101 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.707006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-config-volume\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.707101 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.707022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5k2q\" (UniqueName: \"kubernetes.io/projected/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-kube-api-access-x5k2q\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.707101 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.707093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-metrics-tls\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.707186 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.707169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b353680-167d-4d3e-aa95-2ddbd90d7566-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.707222 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.707198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7ctj\" (UniqueName: \"kubernetes.io/projected/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-api-access-p7ctj\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.808284 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc63aebd-9b64-45a5-970c-d07427cb4654-cert\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:36:40.808491 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nsn\" (UniqueName: \"kubernetes.io/projected/fc63aebd-9b64-45a5-970c-d07427cb4654-kube-api-access-58nsn\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:36:40.808491 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-config-volume\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.808491 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808365    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5k2q\" (UniqueName: \"kubernetes.io/projected/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-kube-api-access-x5k2q\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.808491 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-metrics-tls\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.808491 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b353680-167d-4d3e-aa95-2ddbd90d7566-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.808491 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7ctj\" (UniqueName: \"kubernetes.io/projected/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-api-access-p7ctj\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.808807 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-tmp-dir\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.808807 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b353680-167d-4d3e-aa95-2ddbd90d7566-data-volume\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.808807 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b353680-167d-4d3e-aa95-2ddbd90d7566-crio-socket\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.808807 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.808649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.809042 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.809018    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-tmp-dir\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.809112 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.809050    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-config-volume\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.809288 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.809268    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.809339 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.809303    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b353680-167d-4d3e-aa95-2ddbd90d7566-crio-socket\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.809339 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.809322    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b353680-167d-4d3e-aa95-2ddbd90d7566-data-volume\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.812645 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.812619    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-metrics-tls\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.812738 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.812697    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b353680-167d-4d3e-aa95-2ddbd90d7566-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.812812 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.812797    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc63aebd-9b64-45a5-970c-d07427cb4654-cert\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:36:40.871100 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.871057    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5k2q\" (UniqueName: \"kubernetes.io/projected/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-kube-api-access-x5k2q\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.871100 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.871078    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7ctj\" (UniqueName: \"kubernetes.io/projected/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-api-access-p7ctj\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:40.871326 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.871111    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58nsn\" (UniqueName: \"kubernetes.io/projected/fc63aebd-9b64-45a5-970c-d07427cb4654-kube-api-access-58nsn\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:36:40.895724 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.895640    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:40.917458 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.917429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:36:40.973777 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:40.973744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:36:41.167873 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.167789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:41.167873 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.167807    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:41.168078 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.168002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:41.221369 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.221339    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:36:41.221547 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.221382    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:36:41.221547 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.221495    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqxsv\""
Oct 30 20:36:41.221708 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.221692    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-x2fjq\""
Oct 30 20:36:41.221759 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.221693    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:36:41.221759 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.221721    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-csvtm\""
Oct 30 20:36:41.221822 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.221803    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:36:41.366457 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.366428    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2sj2r"]
Oct 30 20:36:41.370488 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.370427    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xrcmf"]
Oct 30 20:36:41.371347 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.371329    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-42h66"]
Oct 30 20:36:41.374611 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:41.370310    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc63aebd_9b64_45a5_970c_d07427cb4654.slice/crio-f70d096fe0e6e2c598f357a14c16a761c5e494954654251463e2530efa08a2b3 WatchSource:0}: Error finding container f70d096fe0e6e2c598f357a14c16a761c5e494954654251463e2530efa08a2b3: Status 404 returned error can't find the container with id f70d096fe0e6e2c598f357a14c16a761c5e494954654251463e2530efa08a2b3
Oct 30 20:36:41.423018 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.422990    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2sj2r" event={"ID":"fc63aebd-9b64-45a5-970c-d07427cb4654","Type":"ContainerStarted","Data":"f70d096fe0e6e2c598f357a14c16a761c5e494954654251463e2530efa08a2b3"}
Oct 30 20:36:41.424262 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.424236    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-42h66" event={"ID":"1b353680-167d-4d3e-aa95-2ddbd90d7566","Type":"ContainerStarted","Data":"9d6d8c24722058fe636ec19a07a2404a299f3dcc7f892fe7c391a60df62f8f21"}
Oct 30 20:36:41.425456 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:41.425437    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xrcmf" event={"ID":"03bdd5a3-703a-4c94-bf8c-53987d38e2a9","Type":"ContainerStarted","Data":"fcb92f66ea3c5b19cc5c805482f74e613e8fa7f3a935582de0a015119ecb2bdb"}
Oct 30 20:36:42.430281 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:42.430243    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-42h66" event={"ID":"1b353680-167d-4d3e-aa95-2ddbd90d7566","Type":"ContainerStarted","Data":"56f7c80edfbbdd6307199696b5f6f4eaddaf2d221e6b416554fded67c91b77e3"}
Oct 30 20:36:43.435533 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:43.435444    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-42h66" event={"ID":"1b353680-167d-4d3e-aa95-2ddbd90d7566","Type":"ContainerStarted","Data":"c6cd720ca38f53ab42968abcba01575619f1cb72c17b82086550816816055bda"}
Oct 30 20:36:44.175771 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.175692    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"]
Oct 30 20:36:44.186761 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.186725    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.242575 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.240208    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"]
Oct 30 20:36:44.249465 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.249433    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:36:44.249646 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.249486    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:36:44.249646 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.249485    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:36:44.250805 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.250772    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q82tz\""
Oct 30 20:36:44.250935 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.250899    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 20:36:44.251007 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.250980    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 20:36:44.294045 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.294012    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4mlm5"]
Oct 30 20:36:44.311499 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.311462    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"]
Oct 30 20:36:44.311692 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.311624    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.329739 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.329713    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.339942 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.339908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc7n7\" (UniqueName: \"kubernetes.io/projected/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-kube-api-access-cc7n7\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.340090 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.339981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.340158 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.340077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.340158 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.340117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.379280 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.379246    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"]
Oct 30 20:36:44.440568 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.440404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.440568 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.440447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.440568 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.440475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.440560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnbz6\" (UniqueName: \"kubernetes.io/projected/f1788d1c-9101-4856-933c-199b6ced5caa-kube-api-access-dnbz6\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.440680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.440733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1788d1c-9101-4856-933c-199b6ced5caa-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.440794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.440819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-textfile\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.440853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5dk8\" (UniqueName: \"kubernetes.io/projected/6987d150-7d2e-425b-8408-a64895782e1d-kube-api-access-r5dk8\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-sys\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.441124 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-metrics-client-ca\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.441658 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-tls\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.441658 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc7n7\" (UniqueName: \"kubernetes.io/projected/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-kube-api-access-cc7n7\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.441658 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-root\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.441658 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.441658 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.441658 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441333    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-wtmp\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.441942 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441679    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.441942 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441798    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xrcmf" event={"ID":"03bdd5a3-703a-4c94-bf8c-53987d38e2a9","Type":"ContainerStarted","Data":"5348f476caec6ba3e5170079c77e4262c916c1ec6c800758dfddf4d3c3460507"}
Oct 30 20:36:44.441942 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.441853    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xrcmf" event={"ID":"03bdd5a3-703a-4c94-bf8c-53987d38e2a9","Type":"ContainerStarted","Data":"a7087a82eafddcf4107d99d0aef4ff8f82290c6cc782ce5c1d08037fefdde1bd"}
Oct 30 20:36:44.442119 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.442099    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:44.444032 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.444000    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.444115 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.444069    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.445809 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.445787    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:36:44.445902 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.445852    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 20:36:44.446346 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.446326    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5v6zk\""
Oct 30 20:36:44.446446 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.446372    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:36:44.446446 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.446411    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 20:36:44.446554 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.446508    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 20:36:44.446612 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.446577    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:36:44.446889 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.446877    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2nknl\""
Oct 30 20:36:44.505978 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.505874    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc7n7\" (UniqueName: \"kubernetes.io/projected/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-kube-api-access-cc7n7\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.520359 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.520329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:36:44.542600 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542560    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.542772 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.542772 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.542772 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnbz6\" (UniqueName: \"kubernetes.io/projected/f1788d1c-9101-4856-933c-199b6ced5caa-kube-api-access-dnbz6\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.542772 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.542965 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1788d1c-9101-4856-933c-199b6ced5caa-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.542965 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.542965 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-textfile\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.542965 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5dk8\" (UniqueName: \"kubernetes.io/projected/6987d150-7d2e-425b-8408-a64895782e1d-kube-api-access-r5dk8\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.542965 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-sys\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.542965 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-metrics-client-ca\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.543175 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.542996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-tls\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.543175 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.543026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-root\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.543175 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.543056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.543175 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.543082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-wtmp\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.543308 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.543183    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.543308 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.543222    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-wtmp\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.544578 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.543508    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-textfile\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.544578 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.543923    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-metrics-client-ca\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.544578 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.544410    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-sys\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.544578 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.543929    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-root\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.544883 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.544856    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.544966 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.544941    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.545477 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.545222    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1788d1c-9101-4856-933c-199b6ced5caa-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.546648 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.546623    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-tls\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.546755 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.546693    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.547680 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.547655    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.548157 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.548132    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.584132 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.584074    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-xrcmf" podStartSLOduration=2.122978461 podStartE2EDuration="4.58405844s" totalImagesPullingTime="2.461079979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:44.583160919 +0000 UTC m=+51.940233946" watchObservedRunningTime="2026-10-30 20:36:44.58405844 +0000 UTC m=+51.941131465"
Oct 30 20:36:44.615632 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.615568    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5dk8\" (UniqueName: \"kubernetes.io/projected/6987d150-7d2e-425b-8408-a64895782e1d-kube-api-access-r5dk8\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.624081 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.623853    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnbz6\" (UniqueName: \"kubernetes.io/projected/f1788d1c-9101-4856-933c-199b6ced5caa-kube-api-access-dnbz6\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.672453 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.672420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:36:44.702919 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:44.702883    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6987d150_7d2e_425b_8408_a64895782e1d.slice/crio-46d6e7ae9450ac38cf3972220ae17d8cf88a7a38e5efe3696204f1f37e7d7cf7 WatchSource:0}: Error finding container 46d6e7ae9450ac38cf3972220ae17d8cf88a7a38e5efe3696204f1f37e7d7cf7: Status 404 returned error can't find the container with id 46d6e7ae9450ac38cf3972220ae17d8cf88a7a38e5efe3696204f1f37e7d7cf7
Oct 30 20:36:44.724282 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.724238    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:36:44.951257 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:44.951166    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"]
Oct 30 20:36:44.980152 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:44.980111    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9c0987_5531_4120_9ad2_fc7124ee8d5d.slice/crio-434e2bd2119dcb3faa3d0ede2743fff1c26898d9756a6f04686fc497f463b234 WatchSource:0}: Error finding container 434e2bd2119dcb3faa3d0ede2743fff1c26898d9756a6f04686fc497f463b234: Status 404 returned error can't find the container with id 434e2bd2119dcb3faa3d0ede2743fff1c26898d9756a6f04686fc497f463b234
Oct 30 20:36:45.122596 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:45.122564    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"]
Oct 30 20:36:45.285845 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:45.285822    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1788d1c_9101_4856_933c_199b6ced5caa.slice/crio-41a7895da92cbf3614e603836a01ee207ba2bd4d6ae6fda219275055eddd6922 WatchSource:0}: Error finding container 41a7895da92cbf3614e603836a01ee207ba2bd4d6ae6fda219275055eddd6922: Status 404 returned error can't find the container with id 41a7895da92cbf3614e603836a01ee207ba2bd4d6ae6fda219275055eddd6922
Oct 30 20:36:45.445914 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:45.445868    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4mlm5" event={"ID":"6987d150-7d2e-425b-8408-a64895782e1d","Type":"ContainerStarted","Data":"46d6e7ae9450ac38cf3972220ae17d8cf88a7a38e5efe3696204f1f37e7d7cf7"}
Oct 30 20:36:45.447886 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:45.447849    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v" event={"ID":"ef9c0987-5531-4120-9ad2-fc7124ee8d5d","Type":"ContainerStarted","Data":"862206fbecaa2244f19f0d100322557f4ed47b17c528a7a8f2abf3bb5982e4f0"}
Oct 30 20:36:45.448008 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:45.447923    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v" event={"ID":"ef9c0987-5531-4120-9ad2-fc7124ee8d5d","Type":"ContainerStarted","Data":"25c479fc8fc28ccb52ba0fe80d112521416af7e5b989fb2c6206c3d4b7bf62a6"}
Oct 30 20:36:45.448008 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:45.447952    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v" event={"ID":"ef9c0987-5531-4120-9ad2-fc7124ee8d5d","Type":"ContainerStarted","Data":"434e2bd2119dcb3faa3d0ede2743fff1c26898d9756a6f04686fc497f463b234"}
Oct 30 20:36:45.449093 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:45.449074    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b" event={"ID":"f1788d1c-9101-4856-933c-199b6ced5caa","Type":"ContainerStarted","Data":"41a7895da92cbf3614e603836a01ee207ba2bd4d6ae6fda219275055eddd6922"}
Oct 30 20:36:46.455401 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.455356    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-42h66" event={"ID":"1b353680-167d-4d3e-aa95-2ddbd90d7566","Type":"ContainerStarted","Data":"ceec01a5954a281b7d4c5f2fa5758d0b1eb8882fea642fce72a4f3e98bc886d6"}
Oct 30 20:36:46.456988 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.456962    2577 generic.go:356] "Generic (PLEG): container finished" podID="6987d150-7d2e-425b-8408-a64895782e1d" containerID="5a74e3e5db9026a19ba3d1db6d5903131e593e2957a467d5409a11f621e24e77" exitCode=0
Oct 30 20:36:46.457091 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.457051    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4mlm5" event={"ID":"6987d150-7d2e-425b-8408-a64895782e1d","Type":"ContainerDied","Data":"5a74e3e5db9026a19ba3d1db6d5903131e593e2957a467d5409a11f621e24e77"}
Oct 30 20:36:46.458471 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.458443    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2sj2r" event={"ID":"fc63aebd-9b64-45a5-970c-d07427cb4654","Type":"ContainerStarted","Data":"169dd7ab7d6b6aefef6c2799509941d73a4a2c72cefca6363dbd42349f22ec2d"}
Oct 30 20:36:46.556754 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.556724    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:36:46.559661 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.559635    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.578152 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.578104    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-42h66" podStartSLOduration=2.659807906 podStartE2EDuration="6.578086117s" totalImagesPullingTime="3.918278211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:36:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:46.576929227 +0000 UTC m=+53.934002252" watchObservedRunningTime="2026-10-30 20:36:46.578086117 +0000 UTC m=+53.935159144"
Oct 30 20:36:46.614315 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.614216    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 20:36:46.614315 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.614281    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 20:36:46.614315 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.614283    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 20:36:46.614887 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.614757    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 20:36:46.614887 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.614817    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 20:36:46.614887 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.614832    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 20:36:46.614887 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.614843    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 20:36:46.614887 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.614869    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 20:36:46.615081 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.614941    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wql4r\""
Oct 30 20:36:46.660166 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660347 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660179    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660347 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660347 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660517 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660517 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd2kj\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-kube-api-access-cd2kj\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660517 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-web-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660517 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-out\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660725 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660725 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660725 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660725 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.660725 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.660690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.665810 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.665782    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 20:36:46.672086 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.672065    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:36:46.761416 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-out\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761416 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761416 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761691 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761691 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761467    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761691 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761691 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761691 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761691 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761691 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761967 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761967 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd2kj\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-kube-api-access-cd2kj\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.761967 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.761808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-web-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.762188 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.762153    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.762926 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.762618    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.762926 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.762906    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.765458 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.765432    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.767867 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.767442    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.767867 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.767813    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.767867 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.767829    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-web-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.768276 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.768239    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-out\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.768510 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.768458    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.769504 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.769479    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.771708 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.771684    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.773959 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.773939    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.826425 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.826397    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd2kj\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-kube-api-access-cd2kj\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.862558 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.862483    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2sj2r" podStartSLOduration=2.752971372 podStartE2EDuration="6.862465933s" totalImagesPullingTime="4.109494561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:46.861664279 +0000 UTC m=+54.218737325" watchObservedRunningTime="2026-10-30 20:36:46.862465933 +0000 UTC m=+54.219538959"
Oct 30 20:36:46.884145 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.884109    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:36:46.943447 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.942436    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"]
Oct 30 20:36:46.955267 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:46.955241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.000112 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.000071    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"]
Oct 30 20:36:47.017812 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.017791    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cgl3iiubi2irp\""
Oct 30 20:36:47.017932 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.017789    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 20:36:47.017932 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.017857    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 20:36:47.017932 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.017888    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 20:36:47.018130 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.017946    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 20:36:47.018130 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.017997    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hrrpw\""
Oct 30 20:36:47.018130 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.018002    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 20:36:47.063903 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.063868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9361050c-c0f0-4eff-a31e-7fa06644b9b8-tmp\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.063975 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.063958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.064010 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.063992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.064059 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.064029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-grpc-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.064059 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.064050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77jkc\" (UniqueName: \"kubernetes.io/projected/9361050c-c0f0-4eff-a31e-7fa06644b9b8-kube-api-access-77jkc\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.064179 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.064157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.064220 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.064195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.064254 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.064227    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.064297 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.064257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9361050c-c0f0-4eff-a31e-7fa06644b9b8-metrics-client-ca\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.165675 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.165634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.165862 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.165689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.165862 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.165725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.165862 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.165773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9361050c-c0f0-4eff-a31e-7fa06644b9b8-metrics-client-ca\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.165862 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.165836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9361050c-c0f0-4eff-a31e-7fa06644b9b8-tmp\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.166063 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.165869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.166063 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.165900    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.166063 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.165949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-grpc-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.166063 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.165974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jkc\" (UniqueName: \"kubernetes.io/projected/9361050c-c0f0-4eff-a31e-7fa06644b9b8-kube-api-access-77jkc\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.166726 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.166693    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9361050c-c0f0-4eff-a31e-7fa06644b9b8-metrics-client-ca\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.166968 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.166939    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9361050c-c0f0-4eff-a31e-7fa06644b9b8-tmp\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.169328 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.168874    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.169328 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.169286    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.169455 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.169336    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.169589 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.169569    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.169914 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.169890    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-grpc-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.170619 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.170598    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.228322 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.228291    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jkc\" (UniqueName: \"kubernetes.io/projected/9361050c-c0f0-4eff-a31e-7fa06644b9b8-kube-api-access-77jkc\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.277268 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.277193    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:47.337758 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.337668    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 30 20:36:47.347613 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:47.347581    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1daa3d8_62fd_42cc_9621_dfd1606010ce.slice/crio-ad8c1ccccb4a747d34f72f3688354bc8104c71b0901defb958d6238aa972cf5f WatchSource:0}: Error finding container ad8c1ccccb4a747d34f72f3688354bc8104c71b0901defb958d6238aa972cf5f: Status 404 returned error can't find the container with id ad8c1ccccb4a747d34f72f3688354bc8104c71b0901defb958d6238aa972cf5f
Oct 30 20:36:47.463507 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.463481    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4mlm5" event={"ID":"6987d150-7d2e-425b-8408-a64895782e1d","Type":"ContainerStarted","Data":"656032de78b8ef34db311729aeeec9916677f81f1cbc629154b361079b4a8676"}
Oct 30 20:36:47.463953 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.463564    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4mlm5" event={"ID":"6987d150-7d2e-425b-8408-a64895782e1d","Type":"ContainerStarted","Data":"6dee031dc7e67df7de4528fc942d0ffb4b06dfa199ccfbab985c9a5f35ec23e4"}
Oct 30 20:36:47.466561 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.466342    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v" event={"ID":"ef9c0987-5531-4120-9ad2-fc7124ee8d5d","Type":"ContainerStarted","Data":"446b4ff8b0b9f85e03f530c102d9da956b1cab2b2b24629bbeb6b863bef7d804"}
Oct 30 20:36:47.468267 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.467958    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e1daa3d8-62fd-42cc-9621-dfd1606010ce","Type":"ContainerStarted","Data":"ad8c1ccccb4a747d34f72f3688354bc8104c71b0901defb958d6238aa972cf5f"}
Oct 30 20:36:47.469789 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.469762    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b" event={"ID":"f1788d1c-9101-4856-933c-199b6ced5caa","Type":"ContainerStarted","Data":"6fe50ce3428f543fd6876f66ef803b987e8a6c5f5428407062dcb15cbf2cba63"}
Oct 30 20:36:47.586317 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.586272    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4mlm5" podStartSLOduration=1.9470932859999999 podStartE2EDuration="3.586258901s" totalImagesPullingTime="1.555282363s" totalInitContainerRuntime="83.883252ms" isStatefulPod=true podCreationTimestamp="2026-10-30 20:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:47.586072105 +0000 UTC m=+54.943145152" watchObservedRunningTime="2026-10-30 20:36:47.586258901 +0000 UTC m=+54.943331919"
Oct 30 20:36:47.656349 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.656306    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"]
Oct 30 20:36:47.661861 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:47.661834    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9361050c_c0f0_4eff_a31e_7fa06644b9b8.slice/crio-0a5032bfa0e2e25fb0931e2219d8fd0adbbb177aaec3103d1a567255df5a6f62 WatchSource:0}: Error finding container 0a5032bfa0e2e25fb0931e2219d8fd0adbbb177aaec3103d1a567255df5a6f62: Status 404 returned error can't find the container with id 0a5032bfa0e2e25fb0931e2219d8fd0adbbb177aaec3103d1a567255df5a6f62
Oct 30 20:36:47.706245 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:47.706192    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v" podStartSLOduration=1.9887817490000002 podStartE2EDuration="3.706178186s" totalImagesPullingTime="1.717396437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:47.705679692 +0000 UTC m=+55.062752717" watchObservedRunningTime="2026-10-30 20:36:47.706178186 +0000 UTC m=+55.063251209"
Oct 30 20:36:48.475983 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:48.475935    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b" event={"ID":"f1788d1c-9101-4856-933c-199b6ced5caa","Type":"ContainerStarted","Data":"5bebeba878722d0400aeebec1f143731f184e6db88ddae4ed756823be35c7b01"}
Oct 30 20:36:48.475983 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:48.476011    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b" event={"ID":"f1788d1c-9101-4856-933c-199b6ced5caa","Type":"ContainerStarted","Data":"14772acd5c2c322a5a0f73f5649b1b8e39ff2ad37bfe414761accf0cd3abc902"}
Oct 30 20:36:48.477221 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:48.477182    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss" event={"ID":"9361050c-c0f0-4eff-a31e-7fa06644b9b8","Type":"ContainerStarted","Data":"0a5032bfa0e2e25fb0931e2219d8fd0adbbb177aaec3103d1a567255df5a6f62"}
Oct 30 20:36:48.598683 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:48.598617    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b" podStartSLOduration=2.671049526 podStartE2EDuration="4.598599188s" totalImagesPullingTime="1.927549662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:48.597240567 +0000 UTC m=+55.954313594" watchObservedRunningTime="2026-10-30 20:36:48.598599188 +0000 UTC m=+55.955672216"
Oct 30 20:36:48.961741 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:48.961714    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"]
Oct 30 20:36:48.967303 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:48.967018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:48.980153 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:48.980122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:48.980252 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:48.980165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96tsr\" (UniqueName: \"kubernetes.io/projected/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-kube-api-access-96tsr\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:49.024447 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.024418    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fzf7s\""
Oct 30 20:36:49.025162 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.025143    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 20:36:49.025340 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.025283    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"]
Oct 30 20:36:49.080888 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.080856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:49.080888 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.080888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96tsr\" (UniqueName: \"kubernetes.io/projected/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-kube-api-access-96tsr\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:49.083571 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.083518    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:49.143424 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.143396    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96tsr\" (UniqueName: \"kubernetes.io/projected/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-kube-api-access-96tsr\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:49.152261 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.152196    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75fcff69cb-6r6fm"]
Oct 30 20:36:49.154587 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.154568    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.182130 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.182105    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8lp7\" (UniqueName: \"kubernetes.io/projected/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-kube-api-access-z8lp7\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.182283 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.182149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-tls\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.182283 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.182243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-metrics-server-audit-profiles\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.182283 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.182275    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-client-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.182430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.182315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.182430 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.182369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-client-certs\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.182511 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.182472    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-audit-log\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.207979 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.207953    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 20:36:49.208109 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.208033    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 20:36:49.208152 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.208119    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 20:36:49.208289 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.208275    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 20:36:49.208323 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.208309    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2q2tq\""
Oct 30 20:36:49.208392 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.208371    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cp5qmlj8ebn7l\""
Oct 30 20:36:49.215928 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.215906    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75fcff69cb-6r6fm"]
Oct 30 20:36:49.279678 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.279648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:49.283753 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.283723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.283871 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.283765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-client-certs\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.283871 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.283818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-audit-log\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.284023 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.283891    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8lp7\" (UniqueName: \"kubernetes.io/projected/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-kube-api-access-z8lp7\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.284023 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.283928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-tls\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.284023 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.283974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-metrics-server-audit-profiles\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.284023 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.284006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-client-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.284515 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.284465    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.284647 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.284590    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-audit-log\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.285595 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.285570    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-metrics-server-audit-profiles\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.286830 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.286808    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-client-certs\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.286931 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.286897    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-client-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.287155 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.287114    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-tls\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.346769 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.346714    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8lp7\" (UniqueName: \"kubernetes.io/projected/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-kube-api-access-z8lp7\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.387277 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.387248    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:36:49.465005 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.464975    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:36:49.483396 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.483344    2577 generic.go:356] "Generic (PLEG): container finished" podID="e1daa3d8-62fd-42cc-9621-dfd1606010ce" containerID="7201f00ca7171606280f6d37f82236a5381ab191574165f9211ecca4b11d89b0" exitCode=0
Oct 30 20:36:49.483868 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.483421    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e1daa3d8-62fd-42cc-9621-dfd1606010ce","Type":"ContainerDied","Data":"7201f00ca7171606280f6d37f82236a5381ab191574165f9211ecca4b11d89b0"}
Oct 30 20:36:49.655420 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.655399    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"]
Oct 30 20:36:49.658344 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:49.658317    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ec14b2_fe21_4c77_b9ed_6bf134a5e38b.slice/crio-00b22f897fd1f4de08eab52a264722732f7a781875ff11736a7ee323bac71c18 WatchSource:0}: Error finding container 00b22f897fd1f4de08eab52a264722732f7a781875ff11736a7ee323bac71c18: Status 404 returned error can't find the container with id 00b22f897fd1f4de08eab52a264722732f7a781875ff11736a7ee323bac71c18
Oct 30 20:36:49.856352 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:49.856322    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75fcff69cb-6r6fm"]
Oct 30 20:36:49.858718 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:49.858692    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb0dbc9_7c90_4df9_a53f_fb5a7163993a.slice/crio-9c4067daa3f2daeac38cf4c8173401923fd1f5e4b7cf78164f9509bc97b8d573 WatchSource:0}: Error finding container 9c4067daa3f2daeac38cf4c8173401923fd1f5e4b7cf78164f9509bc97b8d573: Status 404 returned error can't find the container with id 9c4067daa3f2daeac38cf4c8173401923fd1f5e4b7cf78164f9509bc97b8d573
Oct 30 20:36:50.007418 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.007370    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-57d58748d4-z9zfx"]
Oct 30 20:36:50.010263 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.010241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.064183 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.064094    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 20:36:50.064183 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.064114    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 20:36:50.064183 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.064099    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 20:36:50.064183 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.064119    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 20:36:50.064522 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.064349    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dz8l9\""
Oct 30 20:36:50.064522 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.064358    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 20:36:50.090983 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.090951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.091157 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.090987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-metrics-client-ca\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.091157 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.091018    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-federate-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.091157 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.091119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59nw9\" (UniqueName: \"kubernetes.io/projected/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-kube-api-access-59nw9\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.091277 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.091189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.091277 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.091245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.091277 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.091261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.091413 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.091372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-serving-certs-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.114659 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.114574    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 20:36:50.116160 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.116131    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57d58748d4-z9zfx"]
Oct 30 20:36:50.192397 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.192361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.192397 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.192398    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-metrics-client-ca\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.192666 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.192427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-federate-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.192666 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.192471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59nw9\" (UniqueName: \"kubernetes.io/projected/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-kube-api-access-59nw9\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.192666 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.192501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.192666 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.192570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.192666 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.192590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.192666 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.192663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-serving-certs-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.194040 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.194010    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-metrics-client-ca\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.194605 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.194579    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-serving-certs-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.195305 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.195284    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.195569 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.195532    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-federate-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.195784 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.195765    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.196093 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.196069    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.196461 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.196434    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.255331 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.255296    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59nw9\" (UniqueName: \"kubernetes.io/projected/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-kube-api-access-59nw9\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.324597 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.324553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:36:50.489212 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.489167    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm" event={"ID":"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a","Type":"ContainerStarted","Data":"9c4067daa3f2daeac38cf4c8173401923fd1f5e4b7cf78164f9509bc97b8d573"}
Oct 30 20:36:50.490849 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.490822    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p" event={"ID":"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b","Type":"ContainerStarted","Data":"00b22f897fd1f4de08eab52a264722732f7a781875ff11736a7ee323bac71c18"}
Oct 30 20:36:50.772070 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:50.772038    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57d58748d4-z9zfx"]
Oct 30 20:36:51.497984 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:51.497783    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss" event={"ID":"9361050c-c0f0-4eff-a31e-7fa06644b9b8","Type":"ContainerStarted","Data":"5b667ca5c0c5b0653a60310f548dee9f0b5b14aa98b591f7ae90f92ef1d1bed2"}
Oct 30 20:36:51.497984 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:51.497886    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss" event={"ID":"9361050c-c0f0-4eff-a31e-7fa06644b9b8","Type":"ContainerStarted","Data":"88ad6b0acca4aa005cdb74edc39bdf3ea8064eb151b3acc3c4534edbc9d4b7e1"}
Oct 30 20:36:51.497984 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:51.497932    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss" event={"ID":"9361050c-c0f0-4eff-a31e-7fa06644b9b8","Type":"ContainerStarted","Data":"f902bcfbe0301b9f07e7cfa47864a8bd74b6c9efc5a4b500ddf164847f77b028"}
Oct 30 20:36:51.499263 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:51.499193    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx" event={"ID":"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2","Type":"ContainerStarted","Data":"2d0e2c4d35ee9774599016a0414f234c0216bc44a9ee0f0ea944ceb45eb17d51"}
Oct 30 20:36:52.507431 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.507378    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e1daa3d8-62fd-42cc-9621-dfd1606010ce","Type":"ContainerStarted","Data":"0c3d379e90221ba32991b6066d363ec5481961c1d7ed7e8f831fe066c684a3cd"}
Oct 30 20:36:52.507855 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.507494    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e1daa3d8-62fd-42cc-9621-dfd1606010ce","Type":"ContainerStarted","Data":"ee29f04bf450866b5546a6d073be4190b9a0cc325826ca2d65ebe35fcc70fcb5"}
Oct 30 20:36:52.507855 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.507524    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e1daa3d8-62fd-42cc-9621-dfd1606010ce","Type":"ContainerStarted","Data":"d7a9683ee8c8664120935ab9f7f05fd2f04c7b42c8c8087dd56167f99b060879"}
Oct 30 20:36:52.507855 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.507584    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e1daa3d8-62fd-42cc-9621-dfd1606010ce","Type":"ContainerStarted","Data":"0ac1fe06cacf25d9cad848d205dc89b75a6a79dc0a90516342e7e2ce09fc167c"}
Oct 30 20:36:52.507855 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.507621    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e1daa3d8-62fd-42cc-9621-dfd1606010ce","Type":"ContainerStarted","Data":"80a83868cc7935a71f753d80d047e56807f3c0e9acaf43d66a9d900ed02be753"}
Oct 30 20:36:52.509600 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.509566    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm" event={"ID":"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a","Type":"ContainerStarted","Data":"fde318a3084f2a1b85fc2aaf8a8a23f307a1fd33ba0dc46dd3534b850a0d4b7a"}
Oct 30 20:36:52.513966 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.513933    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss" event={"ID":"9361050c-c0f0-4eff-a31e-7fa06644b9b8","Type":"ContainerStarted","Data":"beac73c32471f98e282bdc1093acd10ea41f8cea7a2f08535cc661f01b9e79a6"}
Oct 30 20:36:52.514065 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.514012    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss" event={"ID":"9361050c-c0f0-4eff-a31e-7fa06644b9b8","Type":"ContainerStarted","Data":"da001226bc051eceed4f5fdd9940bb50abf76becaa55b7c2e262b162ca831111"}
Oct 30 20:36:52.514108 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.514066    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss" event={"ID":"9361050c-c0f0-4eff-a31e-7fa06644b9b8","Type":"ContainerStarted","Data":"c2895e007d82ca73c8107f789a25f30bf7e92eee770eafdf099919d2129b22c9"}
Oct 30 20:36:52.514153 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.514111    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:52.515633 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.515609    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p" event={"ID":"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b","Type":"ContainerStarted","Data":"b59658a859ca90f755cbdeca1951680c0bc2e73e14fba0351ec15bd982fd74fd"}
Oct 30 20:36:52.515839 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.515818    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:52.521503 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.521483    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:36:52.757980 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.757876    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm" podStartSLOduration=1.470008394 podStartE2EDuration="3.757859436s" totalImagesPullingTime="2.287851042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:52.630404506 +0000 UTC m=+59.987477544" watchObservedRunningTime="2026-10-30 20:36:52.757859436 +0000 UTC m=+60.114932462"
Oct 30 20:36:52.758915 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.758876    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss" podStartSLOduration=2.355798473 podStartE2EDuration="6.75886086s" totalImagesPullingTime="4.403062387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:52.757526399 +0000 UTC m=+60.114599448" watchObservedRunningTime="2026-10-30 20:36:52.75886086 +0000 UTC m=+60.115933886"
Oct 30 20:36:52.875925 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:52.875865    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p" podStartSLOduration=2.346344223 podStartE2EDuration="4.875850047s" totalImagesPullingTime="2.529505824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:52.874760557 +0000 UTC m=+60.231833604" watchObservedRunningTime="2026-10-30 20:36:52.875850047 +0000 UTC m=+60.232923072"
Oct 30 20:36:53.295093 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.295015    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:36:53.297942 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.297926    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323522 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323646 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323646 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323718 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323718 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323848 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-web-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323848 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323848 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323961 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323961 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323961 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323961 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.323961 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.323957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-config-out\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.324115 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.324063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.324115 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.324089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.324115 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.324108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm2w2\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-kube-api-access-dm2w2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.324208 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.324148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.324208 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.324197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.324295 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.324217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.324346 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.324307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.352372 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.352347    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 20:36:53.352564 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.352524    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 20:36:53.352931 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.352911    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 20:36:53.353040 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.353023    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 20:36:53.353087 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.353065    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 20:36:53.353087 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.353078    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qvn7r\""
Oct 30 20:36:53.353181 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.353144    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 20:36:53.402420 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.402396    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 20:36:53.402582 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.402566    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 20:36:53.402648 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.402602    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 20:36:53.402782 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.402772    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 20:36:53.402831 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.402777    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7vtmti1uni647\""
Oct 30 20:36:53.403495 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.403484    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 20:36:53.403525 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.403496    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 20:36:53.425122 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425208 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425208 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425208 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425345 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425345 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425345 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425345 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425345 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-web-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425570 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425621 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425678 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425678 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425776 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-config-out\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425906 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425906 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.425906 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm2w2\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-kube-api-access-dm2w2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.426201 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.425967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.426201 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.426101    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.426302 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.426198    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.426354 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.426341    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.427601 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.426923    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.427601 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.427259    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.428509 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.428481    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.428639 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.428595    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.428942 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.428917    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.429057 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.428935    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.429159 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.429136    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-web-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.430320 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.430291    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.430320 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.430312    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.430529 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.430514    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-config-out\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.430600 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.430524    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.430842 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.430821    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.431310 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.431292    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.431873 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.431857    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.453387 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.453363    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 20:36:53.453465 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.453369    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 20:36:53.455277 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.455259    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:36:53.456061 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.456044    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.458211 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.458195    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.488917 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.488896    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm2w2\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-kube-api-access-dm2w2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.521443 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.521416    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx" event={"ID":"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2","Type":"ContainerStarted","Data":"9f531024637999726d617063b04bb2f7da739722e2699e565a6c4644e1ec1e53"}
Oct 30 20:36:53.521771 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.521478    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx" event={"ID":"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2","Type":"ContainerStarted","Data":"76adf9be61130a7ca135197f7bfe78ea707eea59fedffcda883d82df25296e1b"}
Oct 30 20:36:53.521771 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.521509    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx" event={"ID":"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2","Type":"ContainerStarted","Data":"c00fc1f0399f70aa8e6a9cd69a65bc36273a36f72b1a31d944210317320e2649"}
Oct 30 20:36:53.524768 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.524744    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e1daa3d8-62fd-42cc-9621-dfd1606010ce","Type":"ContainerStarted","Data":"5e857c33aa95333d4d19c09e5379fcde488dcb83ff0018e8a4517694052568b2"}
Oct 30 20:36:53.613516 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.613465    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:53.647643 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.647595    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx" podStartSLOduration=2.4000356 podStartE2EDuration="4.647580857s" totalImagesPullingTime="2.247545257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:53.645905055 +0000 UTC m=+61.002978102" watchObservedRunningTime="2026-10-30 20:36:53.647580857 +0000 UTC m=+61.004653881"
Oct 30 20:36:53.778498 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:53.778447    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.189249956 podStartE2EDuration="7.778433869s" totalImagesPullingTime="4.571678454s" totalInitContainerRuntime="17.505459ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:53.777848676 +0000 UTC m=+61.134921742" watchObservedRunningTime="2026-10-30 20:36:53.778433869 +0000 UTC m=+61.135506894"
Oct 30 20:36:54.050836 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:54.050711    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 30 20:36:54.053103 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:54.053077    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cba104_6b8b_4503_91aa_724269bcf213.slice/crio-d557873e8a0eb8d17920c150d8eb5d30593ab1b67770b9dc1779b47ae48a96a2 WatchSource:0}: Error finding container d557873e8a0eb8d17920c150d8eb5d30593ab1b67770b9dc1779b47ae48a96a2: Status 404 returned error can't find the container with id d557873e8a0eb8d17920c150d8eb5d30593ab1b67770b9dc1779b47ae48a96a2
Oct 30 20:36:54.451780 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:54.451709    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:36:54.530981 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:54.530947    2577 generic.go:356] "Generic (PLEG): container finished" podID="63cba104-6b8b-4503-91aa-724269bcf213" containerID="4573f63174bcfe5d64d01e9b8cba08164849d68ec689c68599c697856f4bdba8" exitCode=0
Oct 30 20:36:54.531362 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:54.531032    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63cba104-6b8b-4503-91aa-724269bcf213","Type":"ContainerDied","Data":"4573f63174bcfe5d64d01e9b8cba08164849d68ec689c68599c697856f4bdba8"}
Oct 30 20:36:54.531362 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:54.531093    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63cba104-6b8b-4503-91aa-724269bcf213","Type":"ContainerStarted","Data":"d557873e8a0eb8d17920c150d8eb5d30593ab1b67770b9dc1779b47ae48a96a2"}
Oct 30 20:36:58.174667 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.173218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:58.174667 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.173288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:58.231957 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.231927    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:36:58.232133 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.232117    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:36:58.236650 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.236623    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:58.236948 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.236927    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:58.274340 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.274310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:58.326843 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.326818    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:36:58.349148 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.349122    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-x2fjq\""
Oct 30 20:36:58.356742 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.356719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:36:58.384323 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.384265    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqxsv\""
Oct 30 20:36:58.387265 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.387248    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:36:58.392367 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.392350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:36:58.398164 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.398139    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:58.530405 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.530380    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:36:58.554275 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.554246    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63cba104-6b8b-4503-91aa-724269bcf213","Type":"ContainerStarted","Data":"6f48989ae5cbf7ba9b4bcff9a6add6e280a15a39cd98f0eede9bb67e5ba6b853"}
Oct 30 20:36:58.554402 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.554315    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63cba104-6b8b-4503-91aa-724269bcf213","Type":"ContainerStarted","Data":"cb7c1df3ed72b4f9659c4ef09169ff0a7b2932521c3b3589dddc5198ce9570e8"}
Oct 30 20:36:58.554402 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.554345    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63cba104-6b8b-4503-91aa-724269bcf213","Type":"ContainerStarted","Data":"0cb4c27a81006a514e374ccd6a4f039323e6312faea1e3365702aa910bdcdecd"}
Oct 30 20:36:58.554402 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.554375    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63cba104-6b8b-4503-91aa-724269bcf213","Type":"ContainerStarted","Data":"c899ceeec880a6de27bd50aac25f8aeab916fa2753e74b61af3b3900e5a394df"}
Oct 30 20:36:58.554402 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.554406    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63cba104-6b8b-4503-91aa-724269bcf213","Type":"ContainerStarted","Data":"9d65c1f9f091cda364599b13ff1c1e1d87400450e055fec12616bb479e4b4e11"}
Oct 30 20:36:58.554597 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.554433    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63cba104-6b8b-4503-91aa-724269bcf213","Type":"ContainerStarted","Data":"3fae2052e16a48dffbe118f1a5de52df2c9b57dadf29f8d8120dbf85ee80b6db"}
Oct 30 20:36:58.613906 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.613883    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:36:58.712599 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.712573    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-csvtm\""
Oct 30 20:36:58.717579 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.717531    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:36:58.747308 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.747245    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2r44p"]
Oct 30 20:36:58.778907 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:58.778586    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12273a1e_7592_4750_a6e2_58855d489834.slice/crio-14c6c75333837a81c13d0d347227e954b13f94b65cd3236e252cda0975daa97a WatchSource:0}: Error finding container 14c6c75333837a81c13d0d347227e954b13f94b65cd3236e252cda0975daa97a: Status 404 returned error can't find the container with id 14c6c75333837a81c13d0d347227e954b13f94b65cd3236e252cda0975daa97a
Oct 30 20:36:58.809625 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.809604    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jwcss"]
Oct 30 20:36:58.811169 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:58.811138    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7070a33d_27e6_4500_bf51_7902613dec6a.slice/crio-2faebb4ce63ffbc70f8ccb958937772ce3575a8d4e997fd2a5a91e505476504d WatchSource:0}: Error finding container 2faebb4ce63ffbc70f8ccb958937772ce3575a8d4e997fd2a5a91e505476504d: Status 404 returned error can't find the container with id 2faebb4ce63ffbc70f8ccb958937772ce3575a8d4e997fd2a5a91e505476504d
Oct 30 20:36:58.837827 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:58.837787    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.483798547 podStartE2EDuration="5.837774219s" totalImagesPullingTime="3.339270232s" totalInitContainerRuntime="14.70544ms" isStatefulPod=false podCreationTimestamp="2026-10-30 20:36:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:36:58.836118534 +0000 UTC m=+66.193191579" watchObservedRunningTime="2026-10-30 20:36:58.837774219 +0000 UTC m=+66.194847243"
Oct 30 20:36:59.091609 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:59.091585    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j7s49"]
Oct 30 20:36:59.093596 ip-10-0-141-37 kubenswrapper[2577]: W1030 20:36:59.093567    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91d68e8_37c6_4a25_8da1_9917f47cdba7.slice/crio-f36c08ff51693762bddd5986109190eabf824ae1da3e7f137a213e7597e474a1 WatchSource:0}: Error finding container f36c08ff51693762bddd5986109190eabf824ae1da3e7f137a213e7597e474a1: Status 404 returned error can't find the container with id f36c08ff51693762bddd5986109190eabf824ae1da3e7f137a213e7597e474a1
Oct 30 20:36:59.559526 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:59.559483    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j7s49" event={"ID":"c91d68e8-37c6-4a25-8da1-9917f47cdba7","Type":"ContainerStarted","Data":"f36c08ff51693762bddd5986109190eabf824ae1da3e7f137a213e7597e474a1"}
Oct 30 20:36:59.560743 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:59.560716    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jwcss" event={"ID":"7070a33d-27e6-4500-bf51-7902613dec6a","Type":"ContainerStarted","Data":"2faebb4ce63ffbc70f8ccb958937772ce3575a8d4e997fd2a5a91e505476504d"}
Oct 30 20:36:59.561885 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:36:59.561865    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2r44p" event={"ID":"12273a1e-7592-4750-a6e2-58855d489834","Type":"ContainerStarted","Data":"14c6c75333837a81c13d0d347227e954b13f94b65cd3236e252cda0975daa97a"}
Oct 30 20:37:00.571121 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:37:00.571046    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jwcss" event={"ID":"7070a33d-27e6-4500-bf51-7902613dec6a","Type":"ContainerStarted","Data":"1154016c335432d8d9235125ff146258b2749f21af28e59f5ecb7336f79e060c"}
Oct 30 20:37:00.571121 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:37:00.571109    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jwcss" event={"ID":"7070a33d-27e6-4500-bf51-7902613dec6a","Type":"ContainerStarted","Data":"817ab59e0fc3e1d867fd875d63d7eff3d6d74f623ec851bd38f2ce6e8a28bf63"}
Oct 30 20:37:03.584680 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:37:03.584589    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j7s49" event={"ID":"c91d68e8-37c6-4a25-8da1-9917f47cdba7","Type":"ContainerStarted","Data":"02f3e9840d73cf94f990ab06b3604d457eea62590cd22ecaa454b03da4daefab"}
Oct 30 20:37:03.585085 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:37:03.584712    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:37:03.713936 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:37:03.713875    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jwcss" podStartSLOduration=68.231287879 podStartE2EDuration="1m9.713854772s" totalImagesPullingTime="1.482566893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:00.690737549 +0000 UTC m=+68.047810576" watchObservedRunningTime="2026-10-30 20:37:03.713854772 +0000 UTC m=+71.070927801"
Oct 30 20:37:03.714247 ip-10-0-141-37 kubenswrapper[2577]: I1030 20:37:03.714209    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j7s49" podStartSLOduration=65.584382587 podStartE2EDuration="1m9.714203133s" totalImagesPullingTime="4.129820546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:37:03.712254522 +0000 UTC m=+71.069327550" watchObservedRunningTime="2026-10-30 20:37:03.714203133 +0000 UTC m=+71.071276159"
Oct 30 20:37:04.981882 ip-10-0-141-37 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 20:37:04.998962 ip-10-0-141-37 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 20:37:04.999196 ip-10-0-141-37 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 20:37:04.999255 ip-10-0-141-37 systemd[1]: kubelet.service: Consumed 4.676s CPU time.
Oct 30 20:37:05.011073 ip-10-0-141-37 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 20:37:05.074522 ip-10-0-141-37 kubenswrapper[5937]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:37:05.074522 ip-10-0-141-37 kubenswrapper[5937]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 20:37:05.074522 ip-10-0-141-37 kubenswrapper[5937]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:37:05.074522 ip-10-0-141-37 kubenswrapper[5937]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 20:37:05.076780 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076700    5937 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:05.076780 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076779    5937 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:05.076780 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076783    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076787    5937 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076789    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076792    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076795    5937 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076797    5937 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076800    5937 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076802    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076805    5937 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076808    5937 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076810    5937 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076813    5937 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076815    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076818    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076820    5937 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076823    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076827    5937 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076833    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076836    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:05.076880 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076839    5937 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076842    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076845    5937 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076848    5937 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076856    5937 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076859    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076861    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076864    5937 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076868    5937 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076870    5937 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076873    5937 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076876    5937 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076879    5937 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076882    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076885    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076887    5937 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076890    5937 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076893    5937 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076896    5937 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076898    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:05.077340 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076901    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076903    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076906    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076908    5937 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076911    5937 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076913    5937 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076916    5937 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076918    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076921    5937 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076923    5937 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076926    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076928    5937 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076931    5937 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076933    5937 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076936    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076939    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076942    5937 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076945    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076948    5937 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:05.077860 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076951    5937 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076953    5937 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076956    5937 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076958    5937 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076961    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076963    5937 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076966    5937 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076968    5937 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076971    5937 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076974    5937 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076976    5937 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076980    5937 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076982    5937 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076985    5937 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076987    5937 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076989    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076992    5937 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076994    5937 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076997    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.076999    5937 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:05.078317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077002    5937 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077005    5937 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077009    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077011    5937 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077014    5937 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077017    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077019    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077022    5937 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077025    5937 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077027    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077030    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077033    5937 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077036    5937 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077039    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077041    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077044    5937 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077046    5937 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077049    5937 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077051    5937 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:05.078827 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077053    5937 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077056    5937 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077058    5937 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077061    5937 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077064    5937 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077067    5937 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077069    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077904    5937 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077911    5937 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077914    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077917    5937 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077920    5937 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077923    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077926    5937 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077929    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077931    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077934    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077936    5937 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077939    5937 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077941    5937 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:05.079325 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077944    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077948    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077950    5937 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077954    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077957    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077960    5937 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077963    5937 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077965    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077968    5937 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077970    5937 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077973    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077975    5937 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077978    5937 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077980    5937 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077983    5937 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077988    5937 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077992    5937 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077996    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:05.079835 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.077999    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078001    5937 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078004    5937 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078007    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078010    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078013    5937 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078015    5937 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078018    5937 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078020    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078023    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078025    5937 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078028    5937 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078031    5937 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078033    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078036    5937 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078038    5937 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078041    5937 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078043    5937 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078046    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078048    5937 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:05.080271 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078052    5937 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078054    5937 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078057    5937 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078059    5937 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078062    5937 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078064    5937 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078067    5937 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078069    5937 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078072    5937 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078074    5937 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078076    5937 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078079    5937 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078082    5937 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078084    5937 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078087    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078089    5937 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078094    5937 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078096    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078099    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078101    5937 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:05.080807 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078104    5937 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078106    5937 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078109    5937 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078112    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078114    5937 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078117    5937 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078119    5937 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078122    5937 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078124    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078126    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078129    5937 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078131    5937 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078134    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078139    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078142    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078145    5937 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078147    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078150    5937 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078153    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078155    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:05.081312 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078158    5937 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078160    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078164    5937 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078168    5937 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078171    5937 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078174    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078176    5937 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078179    5937 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078182    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078185    5937 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078187    5937 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078190    5937 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078192    5937 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078195    5937 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078197    5937 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078721    5937 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078727    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078730    5937 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078732    5937 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078735    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:05.081809 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078738    5937 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078741    5937 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078743    5937 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078746    5937 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078749    5937 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078752    5937 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078755    5937 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078758    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078760    5937 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078763    5937 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078765    5937 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078768    5937 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078770    5937 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078773    5937 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078775    5937 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078778    5937 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078780    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078783    5937 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078785    5937 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078788    5937 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:05.082317 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078791    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078793    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078797    5937 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078801    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078804    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078807    5937 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078809    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078812    5937 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078815    5937 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078817    5937 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078819    5937 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078822    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078825    5937 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078828    5937 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078830    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078833    5937 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078836    5937 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078839    5937 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078842    5937 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078845    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:05.082856 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078847    5937 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078850    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078852    5937 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078855    5937 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078857    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078860    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078862    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078865    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078867    5937 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078870    5937 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078872    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078875    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078878    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078881    5937 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078883    5937 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078886    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078889    5937 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078891    5937 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078894    5937 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:05.083351 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078897    5937 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078899    5937 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078902    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078904    5937 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078907    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078909    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078912    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078914    5937 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078917    5937 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078919    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078922    5937 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078924    5937 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078927    5937 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078930    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078933    5937 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078935    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078939    5937 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078943    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078947    5937 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:05.083832 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078950    5937 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078953    5937 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078955    5937 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078958    5937 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078960    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078963    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078966    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078968    5937 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078971    5937 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078973    5937 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078976    5937 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078979    5937 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078981    5937 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078984    5937 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078986    5937 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078990    5937 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078993    5937 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.078995    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079001    5937 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:05.084294 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079003    5937 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079006    5937 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079008    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079011    5937 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079101    5937 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079109    5937 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079114    5937 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079120    5937 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079125    5937 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079128    5937 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079132    5937 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079136    5937 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079140    5937 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079143    5937 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079146    5937 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079149    5937 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079156    5937 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079159    5937 flags.go:64] FLAG: --cgroup-root=""
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079162    5937 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079165    5937 flags.go:64] FLAG: --client-ca-file=""
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079168    5937 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079171    5937 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079175    5937 flags.go:64] FLAG: --cluster-domain=""
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079178    5937 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 20:37:05.084802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079181    5937 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079185    5937 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079188    5937 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079191    5937 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079195    5937 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079198    5937 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079201    5937 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079205    5937 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079209    5937 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079212    5937 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079215    5937 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079217    5937 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079222    5937 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079225    5937 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079228    5937 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079231    5937 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079235    5937 flags.go:64] FLAG: --enable-server="true"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079238    5937 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079242    5937 flags.go:64] FLAG: --event-burst="100"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079245    5937 flags.go:64] FLAG: --event-qps="50"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079248    5937 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079251    5937 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079254    5937 flags.go:64] FLAG: --eviction-hard=""
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079259    5937 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 20:37:05.085395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079263    5937 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079266    5937 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079270    5937 flags.go:64] FLAG: --eviction-soft=""
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079272    5937 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079275    5937 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079278    5937 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079281    5937 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079284    5937 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079287    5937 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079290    5937 flags.go:64] FLAG: --feature-gates=""
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079294    5937 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079297    5937 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079300    5937 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079303    5937 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079306    5937 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079311    5937 flags.go:64] FLAG: --help="false"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079314    5937 flags.go:64] FLAG: --hostname-override="ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079318    5937 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079321    5937 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079324    5937 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079327    5937 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079331    5937 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079334    5937 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 20:37:05.086051 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079337    5937 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079340    5937 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079344    5937 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079347    5937 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079350    5937 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079353    5937 flags.go:64] FLAG: --kube-reserved=""
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079356    5937 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079358    5937 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079362    5937 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079366    5937 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079369    5937 flags.go:64] FLAG: --lock-file=""
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079372    5937 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079375    5937 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079378    5937 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079383    5937 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079386    5937 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079389    5937 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079392    5937 flags.go:64] FLAG: --logging-format="text"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079395    5937 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079406    5937 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079411    5937 flags.go:64] FLAG: --manifest-url=""
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079414    5937 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079419    5937 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079422    5937 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079428    5937 flags.go:64] FLAG: --max-pods="110"
Oct 30 20:37:05.086848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079431    5937 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079434    5937 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079437    5937 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079440    5937 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079443    5937 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079446    5937 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079449    5937 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079455    5937 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079459    5937 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079462    5937 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079465    5937 flags.go:64] FLAG: --pod-cidr=""
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079469    5937 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079472    5937 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079475    5937 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079478    5937 flags.go:64] FLAG: --port="10250"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079481    5937 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079485    5937 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-026756ef1d0c42d76"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079488    5937 flags.go:64] FLAG: --qos-reserved=""
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079491    5937 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079494    5937 flags.go:64] FLAG: --register-node="true"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079497    5937 flags.go:64] FLAG: --register-with-taints=""
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079501    5937 flags.go:64] FLAG: --registry-burst="10"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079504    5937 flags.go:64] FLAG: --registry-qps="5"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079507    5937 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079510    5937 flags.go:64] FLAG: --reserved-memory=""
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079514    5937 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 20:37:05.087887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079517    5937 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079520    5937 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079523    5937 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079526    5937 flags.go:64] FLAG: --runonce="false"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079528    5937 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079548    5937 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079551    5937 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079554    5937 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079557    5937 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079560    5937 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079563    5937 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079567    5937 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079569    5937 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079572    5937 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079575    5937 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079578    5937 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079581    5937 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079584    5937 flags.go:64] FLAG: --system-cgroups=""
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079587    5937 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079593    5937 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079595    5937 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079599    5937 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079604    5937 flags.go:64] FLAG: --tls-min-version=""
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079607    5937 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079610    5937 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 20:37:05.088523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079613    5937 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079616    5937 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079619    5937 flags.go:64] FLAG: --v="2"
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079623    5937 flags.go:64] FLAG: --version="false"
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079627    5937 flags.go:64] FLAG: --vmodule=""
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079631    5937 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.079634    5937 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079786    5937 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079789    5937 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079792    5937 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079795    5937 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079798    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079801    5937 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079804    5937 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079807    5937 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079810    5937 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079812    5937 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079815    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079817    5937 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079820    5937 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079822    5937 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:05.089165 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079825    5937 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079827    5937 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079830    5937 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079832    5937 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079835    5937 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079838    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079841    5937 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079844    5937 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079848    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079850    5937 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079853    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079855    5937 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079858    5937 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079860    5937 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079863    5937 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079866    5937 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079868    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079871    5937 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079873    5937 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079876    5937 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:05.089768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079878    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079880    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079883    5937 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079887    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079889    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079892    5937 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079894    5937 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079897    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079899    5937 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079902    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079904    5937 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079906    5937 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079909    5937 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079912    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079914    5937 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079917    5937 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079919    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079922    5937 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079925    5937 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079927    5937 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:05.090391 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079931    5937 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079934    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079936    5937 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079939    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079942    5937 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079944    5937 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079946    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079949    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079951    5937 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079954    5937 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079957    5937 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079959    5937 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079962    5937 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079964    5937 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079967    5937 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079970    5937 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079973    5937 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079975    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079978    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:05.091062 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079980    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079983    5937 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079985    5937 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079988    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079990    5937 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079993    5937 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079995    5937 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.079998    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080000    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080003    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080007    5937 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080010    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080013    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080017    5937 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080020    5937 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080022    5937 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080025    5937 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080027    5937 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080030    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:05.091599 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080032    5937 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080036    5937 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080040    5937 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080043    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080045    5937 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080048    5937 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080050    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080052    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080055    5937 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080059    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080061    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080064    5937 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080067    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080069    5937 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.080095    5937 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:37:05.092115 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080134    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080139    5937 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080141    5937 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080144    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080147    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080149    5937 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080152    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080154    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080157    5937 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080159    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080162    5937 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080165    5937 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080168    5937 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080171    5937 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080173    5937 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080176    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080178    5937 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080181    5937 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080184    5937 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080186    5937 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:05.092479 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080189    5937 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080191    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080194    5937 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080197    5937 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080199    5937 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080202    5937 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080205    5937 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080208    5937 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080210    5937 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080213    5937 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080215    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080218    5937 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080221    5937 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080223    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080226    5937 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080228    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080231    5937 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080234    5937 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080236    5937 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080239    5937 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:05.092992 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080241    5937 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080244    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080246    5937 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080249    5937 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080253    5937 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080255    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080258    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080260    5937 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080263    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080265    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080268    5937 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080270    5937 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080273    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080275    5937 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080278    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080281    5937 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080284    5937 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080286    5937 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080289    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:05.093523 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080292    5937 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080294    5937 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080297    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080299    5937 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080302    5937 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080305    5937 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080308    5937 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080310    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080313    5937 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080315    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080318    5937 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080320    5937 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080322    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080325    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080327    5937 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080330    5937 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080332    5937 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080337    5937 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080340    5937 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:05.094097 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080343    5937 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080345    5937 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080348    5937 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080350    5937 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080353    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080356    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080358    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080361    5937 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080363    5937 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080366    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080368    5937 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080371    5937 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080373    5937 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080376    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080378    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080381    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080384    5937 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080388    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080391    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:05.094682 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080393    5937 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080396    5937 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080399    5937 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080401    5937 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080404    5937 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080406    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080409    5937 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080414    5937 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.080418    5937 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.084822    5937 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.084837    5937 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.084855    5937 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.084859    5937 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084936    5937 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084941    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084944    5937 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084947    5937 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084950    5937 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084953    5937 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:05.095142 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084955    5937 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084958    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084961    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084964    5937 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084972    5937 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084975    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084978    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084982    5937 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084986    5937 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084990    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084993    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084995    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.084998    5937 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085000    5937 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085003    5937 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085006    5937 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085009    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085011    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085014    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:05.095626 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085017    5937 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085019    5937 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085022    5937 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085024    5937 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085027    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085029    5937 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085032    5937 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085035    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085037    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085040    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085042    5937 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085044    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085047    5937 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085050    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085052    5937 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085055    5937 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085057    5937 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085059    5937 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085067    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085070    5937 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:05.096072 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085073    5937 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085075    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085078    5937 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085081    5937 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085083    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085085    5937 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085088    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085091    5937 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085094    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085097    5937 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085099    5937 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085102    5937 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085104    5937 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085107    5937 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085109    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085112    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085114    5937 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085117    5937 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085119    5937 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:05.096587 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085121    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085124    5937 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085126    5937 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085129    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085131    5937 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085134    5937 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085136    5937 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085139    5937 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085141    5937 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085144    5937 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085147    5937 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085149    5937 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085159    5937 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085161    5937 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085164    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085166    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085169    5937 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085171    5937 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085174    5937 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085181    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:05.097040 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085184    5937 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085187    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085190    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085192    5937 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085194    5937 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085197    5937 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085199    5937 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085202    5937 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085204    5937 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085206    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085209    5937 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085211    5937 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085214    5937 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085216    5937 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085218    5937 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085221    5937 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085224    5937 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085229    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085232    5937 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:05.097519 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085235    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085238    5937 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085240    5937 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.085271    5937 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085462    5937 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085467    5937 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085476    5937 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085479    5937 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085482    5937 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085484    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085487    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085490    5937 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085492    5937 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085495    5937 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085498    5937 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085500    5937 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:05.097989 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085503    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085505    5937 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085507    5937 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085510    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085512    5937 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085514    5937 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085517    5937 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085519    5937 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085522    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085524    5937 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085526    5937 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085529    5937 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085531    5937 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085550    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085554    5937 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085558    5937 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085562    5937 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085566    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085570    5937 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085572    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:05.098373 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085575    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085577    5937 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085580    5937 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085588    5937 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085591    5937 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085594    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085596    5937 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085599    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085601    5937 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085603    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085606    5937 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085608    5937 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085610    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085613    5937 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085615    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085618    5937 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085620    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085623    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085626    5937 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:05.098882 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085629    5937 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085632    5937 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085635    5937 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085637    5937 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085639    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085642    5937 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085644    5937 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085646    5937 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085649    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085652    5937 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085654    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085657    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085659    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085662    5937 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085664    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085667    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085669    5937 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085677    5937 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085680    5937 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:05.099468 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085683    5937 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085685    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085688    5937 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085690    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085694    5937 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085698    5937 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085700    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085704    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085707    5937 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085709    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085712    5937 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085714    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085717    5937 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085719    5937 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085722    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085724    5937 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085727    5937 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085729    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085732    5937 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:05.100068 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085734    5937 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085736    5937 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085739    5937 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085741    5937 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085744    5937 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085746    5937 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085748    5937 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085751    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085753    5937 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085755    5937 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085758    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085761    5937 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085768    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085771    5937 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085773    5937 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085776    5937 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:05.100531 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085778    5937 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.085805    5937 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085865    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085870    5937 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085873    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085875    5937 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085878    5937 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085880    5937 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085883    5937 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085885    5937 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085888    5937 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085890    5937 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085893    5937 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085895    5937 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085897    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085900    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 20:37:05.100966 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085902    5937 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085905    5937 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085907    5937 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085910    5937 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085912    5937 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085915    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085917    5937 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085919    5937 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085922    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085924    5937 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085927    5937 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085929    5937 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085932    5937 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085941    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085944    5937 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085946    5937 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085948    5937 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085951    5937 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085954    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085956    5937 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 20:37:05.101343 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085958    5937 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085961    5937 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085963    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085977    5937 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085981    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085984    5937 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085986    5937 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085989    5937 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085991    5937 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085994    5937 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085996    5937 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.085998    5937 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086001    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086003    5937 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086006    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086008    5937 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086010    5937 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086013    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086015    5937 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 20:37:05.101844 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086017    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086020    5937 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086024    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086027    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086031    5937 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086035    5937 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086038    5937 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086046    5937 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086048    5937 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086051    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086053    5937 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086056    5937 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086058    5937 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086061    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086064    5937 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086066    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086069    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086072    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086074    5937 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 20:37:05.102415 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086077    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086079    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086081    5937 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086084    5937 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086086    5937 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086089    5937 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086091    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086094    5937 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086098    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086103    5937 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086106    5937 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086109    5937 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086111    5937 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086114    5937 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086116    5937 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086119    5937 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086122    5937 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086124    5937 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086127    5937 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 20:37:05.103254 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086131    5937 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086135    5937 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086145    5937 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086156    5937 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086160    5937 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086165    5937 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086167    5937 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086170    5937 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086172    5937 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086175    5937 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086177    5937 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086180    5937 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086182    5937 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086185    5937 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:37:05.086187    5937 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.086240    5937 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.088369    5937 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.088434    5937 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.088625    5937 server.go:1014] "Starting client certificate rotation"
Oct 30 20:37:05.103862 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.088755    5937 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 20:37:05.104331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.088804    5937 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 20:30:54 +0000 UTC" deadline="2028-07-29 02:07:59.221375642 +0000 UTC"
Oct 30 20:37:05.104331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.088840    5937 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15293h30m54.132537555s"
Oct 30 20:37:05.104331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.089042    5937 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:37:05.104331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.090092    5937 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 20:37:05.104331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.091320    5937 log.go:25] "Validated CRI v1 runtime API"
Oct 30 20:37:05.104331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.093192    5937 log.go:25] "Validated CRI v1 image API"
Oct 30 20:37:05.104331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.093948    5937 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 20:37:05.104331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.096253    5937 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 91682a5f-0cfe-4796-aedd-b0465acbb083:/dev/nvme0n1p4 c2b35046-c748-4c02-9d1f-87c3aaa516e6:/dev/nvme0n1p3]
Oct 30 20:37:05.104574 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.096273    5937 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/00b22f897fd1f4de08eab52a264722732f7a781875ff11736a7ee323bac71c18/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/00b22f897fd1f4de08eab52a264722732f7a781875ff11736a7ee323bac71c18/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0a5032bfa0e2e25fb0931e2219d8fd0adbbb177aaec3103d1a567255df5a6f62/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0a5032bfa0e2e25fb0931e2219d8fd0adbbb177aaec3103d1a567255df5a6f62/userdata/shm major:0 minor:316 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/14c6c75333837a81c13d0d347227e954b13f94b65cd3236e252cda0975daa97a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/14c6c75333837a81c13d0d347227e954b13f94b65cd3236e252cda0975daa97a/userdata/shm major:0 minor:500 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/16cb19a727c1c3be986f3e18a8262249beb959554bd4af36081fb65ba4424627/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/16cb19a727c1c3be986f3e18a8262249beb959554bd4af36081fb65ba4424627/userdata/shm major:0 minor:62 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1ac6bb8422d4b689d837c90fffa6e9682bf2216158db194f52f965de06987ce8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1ac6bb8422d4b689d837c90fffa6e9682bf2216158db194f52f965de06987ce8/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d0e2c4d35ee9774599016a0414f234c0216bc44a9ee0f0ea944ceb45eb17d51/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d0e2c4d35ee9774599016a0414f234c0216bc44a9ee0f0ea944ceb45eb17d51/userdata/shm major:0 minor:357 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2faebb4ce63ffbc70f8ccb958937772ce3575a8d4e997fd2a5a91e505476504d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2faebb4ce63ffbc70f8ccb958937772ce3575a8d4e997fd2a5a91e505476504d/userdata/shm major:0 minor:503 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/31f6d10f8793f51df1e756087059bc0d418c34cf0bb97ba99003b68f6d429713/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/31f6d10f8793f51df1e756087059bc0d418c34cf0bb97ba99003b68f6d429713/userdata/shm major:0 minor:63 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/41a7895da92cbf3614e603836a01ee207ba2bd4d6ae6fda219275055eddd6922/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/41a7895da92cbf3614e603836a01ee207ba2bd4d6ae6fda219275055eddd6922/userdata/shm major:0 minor:254 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/434e2bd2119dcb3faa3d0ede2743fff1c26898d9756a6f04686fc497f463b234/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/434e2bd2119dcb3faa3d0ede2743fff1c26898d9756a6f04686fc497f463b234/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/46d6e7ae9450ac38cf3972220ae17d8cf88a7a38e5efe3696204f1f37e7d7cf7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/46d6e7ae9450ac38cf3972220ae17d8cf88a7a38e5efe3696204f1f37e7d7cf7/userdata/shm major:0 minor:250 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/673d97b5a582ad4436152ba1940237f50f47c7ed11ae123b276421381675f07b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/673d97b5a582ad4436152ba1940237f50f47c7ed11ae123b276421381675f07b/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8b0071e38686c1662fe21cce2d7cc4371f0fd6fd31136b871fbb8a9c3d637989/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8b0071e38686c1662fe21cce2d7cc4371f0fd6fd31136b871fbb8a9c3d637989/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9c4067daa3f2daeac38cf4c8173401923fd1f5e4b7cf78164f9509bc97b8d573/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9c4067daa3f2daeac38cf4c8173401923fd1f5e4b7cf78164f9509bc97b8d573/userdata/shm major:0 minor:346 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9d6d8c24722058fe636ec19a07a2404a299f3dcc7f892fe7c391a60df62f8f21/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9d6d8c24722058fe636ec19a07a2404a299f3dcc7f892fe7c391a60df62f8f21/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ad8c1ccccb4a747d34f72f3688354bc8104c71b0901defb958d6238aa972cf5f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ad8c1ccccb4a747d34f72f3688354bc8104c71b0901defb958d6238aa972cf5f/userdata/shm major:0 minor:302 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c7b1e837e336dcc848ef35a2964562c55682a198167807ddacc58004f22cde4a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c7b1e837e336dcc848ef35a2964562c55682a198167807ddacc58004f22cde4a/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d1d1c31d6caebe147ff1a102fc878ee5217fd6ea9465ce96676d9138c5d18fda/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d1d1c31d6caebe147ff1a102fc878ee5217fd6ea9465ce96676d9138c5d18fda/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d557873e8a0eb8d17920c150d8eb5d30593ab1b67770b9dc1779b47ae48a96a2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d557873e8a0eb8d17920c150d8eb5d30593ab1b67770b9dc1779b47ae48a96a2/userdata/shm major:0 minor:463 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e56ca3e6ec65a65c84d9b04f11ba180b57a73d29d6a386bc3d552d908989d6f3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e56ca3e6ec65a65c84d9b04f11ba180b57a73d29d6a386bc3d552d908989d6f3/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ecfdfd45ed4274379123a37009a2e79b6b5893230120165e75c58e184e16d818/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ecfdfd45ed4274379123a37009a2e79b6b5893230120165e75c58e184e16d818/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f1423826de9f5bc3ad8722e7a779d6cda553c83a8e05832d82e132f2f2b5865f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f1423826de9f5bc3ad8722e7a779d6cda553c83a8e05832d82e132f2f2b5865f/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f36c08ff51693762bddd5986109190eabf824ae1da3e7f137a213e7597e474a1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f36c08ff51693762bddd5986109190eabf824ae1da3e7f137a213e7597e474a1/userdata/shm major:0 minor:505 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f70d096fe0e6e2c598f357a14c16a761c5e494954654251463e2530efa08a2b3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f70d096fe0e6e2c598f357a14c16a761c5e494954654251463e2530efa08a2b3/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fcb92f66ea3c5b19cc5c805482f74e613e8fa7f3a935582de0a015119ecb2bdb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fcb92f66ea3c5b19cc5c805482f74e613e8fa7f3a935582de0a015119ecb2bdb/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01d5ffb9-a652-4d8f-89f5-9c4657fa3341/volumes/kubernetes.io~projected/kube-api-access-hb82j:{mountpoint:/var/lib/kubelet/pods/01d5ffb9-a652-4d8f-89f5-9c4657fa3341/volumes/kubernetes.io~projected/kube-api-access-hb82j major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03bdd5a3-703a-4c94-bf8c-53987d38e2a9/volumes/kubernetes.io~projected/kube-api-access-x5k2q:{mountpoint:/var/lib/kubelet/pods/03bdd5a3-703a-4c94-bf8c-53987d38e2a9/volumes/kubernetes.io~projected/kube-api-access-x5k2q major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03bdd5a3-703a-4c94-bf8c-53987d38e2a9/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/03bdd5a3-703a-4c94-bf8c-53987d38e2a9/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~projected/kube-api-access-z8lp7:{mountpoint:/var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~projected/kube-api-access-z8lp7 major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:341 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:343 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12273a1e-7592-4750-a6e2-58855d489834/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/12273a1e-7592-4750-a6e2-58855d489834/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:499 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b/volumes/kubernetes.io~projected/kube-api-access-96tsr:{mountpoint:/var/lib/kubelet/pods/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b/volumes/kubernetes.io~projected/kube-api-access-96tsr major:0 minor:339 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:338 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1b353680-167d-4d3e-aa95-2ddbd90d7566/volumes/kubernetes.io~projected/kube-api-access-p7ctj:{mountpoint:/var/lib/kubelet/pods/1b353680-167d-4d3e-aa95-2ddbd90d7566/volumes/kubernetes.io~projected/kube-api-access-p7ctj major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1b353680-167d-4d3e-aa95-2ddbd90d7566/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/1b353680-167d-4d3e-aa95-2ddbd90d7566/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8/volumes/kubernetes.io~projected/kube-api-access-dzz59:{mountpoint:/var/lib/kubelet/pods/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8/volumes/kubernetes.io~projected/kube-api-access-dzz59 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volume-subpaths/web-config/config-reloader/2 major:0 minor:454 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:454 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volume-subpaths/web-config/prometheus/15 major:0 minor:454 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~empty-dir/config-out major:0 minor:455 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~projected/kube-api-access-dm2w2:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~projected/kube-api-access-dm2w2 major:0 minor:462 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~projected/tls-assets major:0 minor:460 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/config major:0 minor:456 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:461 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:453 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:452 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:458 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:457 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:459 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:448 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/web-config major:0 minor:454 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6987d150-7d2e-425b-8408-a64895782e1d/volumes/kubernetes.io~projected/kube-api-access-r5dk8:{mountpoint:/var/lib/kubelet/pods/6987d150-7d2e-425b-8408-a64895782e1d/volumes/kubernetes.io~projected/kube-api-access-r5dk8 major:0 minor:248 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6987d150-7d2e-425b-8408-a64895782e1d/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/6987d150-7d2e-425b-8408-a64895782e1d/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:244 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6987d150-7d2e-425b-8408-a64895782e1d/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/6987d150-7d2e-425b-8408-a64895782e1d/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:242 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6bcfa608-6980-494c-9f02-fb3ebeb52f28/volumes/kubernetes.io~projected/kube-api-access-lbtdv:{mountpoint:/var/lib/kubelet/pods/6bcfa608-6980-494c-9f02-fb3ebeb52f28/volumes/kubernetes.io~projected/kube-api-access-lbtdv major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6dd39a2f-5ae7-4d35-b616-efe9eee803b9/volumes/kubernetes.io~projected/kube-api-access-xmkfc:{mountpoint:/var/lib/kubelet/pods/6dd39a2f-5ae7-4d35-b616-efe9eee803b9/volumes/kubernetes.io~projected/kube-api-access-xmkfc major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7070a33d-27e6-4500-bf51-7902613dec6a/volumes/kubernetes.io~projected/kube-api-access-lhtbv:{mountpoint:/var/lib/kubelet/pods/7070a33d-27e6-4500-bf51-7902613dec6a/volumes/kubernetes.io~projected/kube-api-access-lhtbv major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7070a33d-27e6-4500-bf51-7902613dec6a/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/7070a33d-27e6-4500-bf51-7902613dec6a/volumes/kubernetes.io~secret/metrics-certs major:0 minor:495 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~projected/kube-api-access-59nw9:{mountpoint:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~projected/kube-api-access-59nw9 major:0 minor:356 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/federate-client-tls:{mountpoint:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/federate-client-tls major:0 minor:352 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/secret-telemeter-client:{mountpoint:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/secret-telemeter-client major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config major:0 minor:354 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/telemeter-client-tls:{mountpoint:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/telemeter-client-tls major:0 minor:353 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~projected/kube-api-access-77jkc:{mountpoint:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~projected/kube-api-access-77jkc major:0 minor:315 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:310 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:311 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:306 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad5deab8-b21e-49be-ba98-36639a81e88d/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/ad5deab8-b21e-49be-ba98-36639a81e88d/volumes/kubernetes.io~secret/agent-certs major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bcb1db90-2d6e-4d26-8289-a05a105a2144/volumes/kubernetes.io~projected/kube-api-access-ldmq2:{mountpoint:/var/lib/kubelet/pods/bcb1db90-2d6e-4d26-8289-a05a105a2144/volumes/kubernetes.io~projected/kube-api-access-ldmq2 major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c91d68e8-37c6-4a25-8da1-9917f47cdba7/volumes/kubernetes.io~projected/kube-api-access-gzws7:{mountpoint:/var/lib/kubelet/pods/c91d68e8-37c6-4a25-8da1-9917f47cdba7/volumes/kubernetes.io~projected/kube-api-access-gzws7 major:0 minor:502 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dfdeb085-46f5-41da-8759-3ec51cf47b90/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/dfdeb085-46f5-41da-8759-3ec51cf47b90/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dfdeb085-46f5-41da-8759-3ec51cf47b90/volumes/kubernetes.io~projected/kube-api-access-2qq5k:{mountpoint:/var/lib/kubelet/pods/dfdeb085-46f5-41da-8759-3ec51cf47b90/volumes/kubernetes.io~projected/kube-api-access-2qq5k major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dfdeb085-46f5-41da-8759-3ec51cf47b90/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/dfdeb085-46f5-41da-8759-3ec51cf47b90/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/web-config/alertmanager/9 major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/web-config/config-reloader/6 major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~empty-dir/config-out major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~projected/kube-api-access-cd2kj:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~projected/kube-api-access-cd2kj major:0 minor:301 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~projected/tls-assets major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:296 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/config-volume major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:294 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/web-config major:0 minor:297 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5/volumes/kubernetes.io~empty-dir/tmp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5/volumes/kubernetes.io~projected/kube-api-access-rjblj:{mountpoint:/var/lib/kubelet/pods/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5/volumes/kubernetes.io~projected/kube-api-access-rjblj major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eec25890-c83c-47df-863f-6959537e5c05/volumes/kubernetes.io~projected/kube-api-access-82qk6:{mountpoint:/var/lib/kubelet/pods/eec25890-c83c-47df-863f-6959537e5c05/volumes/kubernetes.io~projected/kube-api-access-82qk6 major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef9c0987-5531-4120-9ad2-fc7124ee8d5d/volumes/kubernetes.io~projected/kube-api-access-cc7n7:{mountpoint:/var/lib/kubelet/pods/ef9c0987-5531-4120-9ad2-fc7124ee8d5d/volumes/kubernetes.io~projected/kube-api-access-cc7n7 major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef9c0987-5531-4120-9ad2-fc7124ee8d5d/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/ef9c0987-5531-4120-9ad2-fc7124ee8d5d/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef9c0987-5531-4120-9ad2-fc7124ee8d5d/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/ef9c0987-5531-4120-9ad2-fc7124ee8d5d/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:240 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1788d1c-9101-4856-933c-199b6ced5caa/volumes/kubernetes.io~projected/kube-api-access-dnbz6:{mountpoint:/var/lib/kubelet/pods/f1788d1c-9101-4856-933c-199b6ced5caa/volumes/kubernetes.io~projected/kube-api-access-dnbz6 major:0 minor:249 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1788d1c-9101-4856-933c-199b6ced5caa/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/f1788d1c-9101-4856-933c-199b6ced5caa/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:243 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f1788d1c-9101-4856-933c-199b6ced5caa/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/f1788d1c-9101-4856-933c-199b6ced5caa/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:245 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc63aebd-9b64-45a5-970c-d07427cb4654/volumes/kubernetes.io~projected/kube-api-access-58nsn:{mountpoint:/var/lib/kubelet/pods/fc63aebd-9b64-45a5-970c-d07427cb4654/volumes/kubernetes.io~projected/kube-api-access-58nsn major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fc63aebd-9b64-45a5-970c-d07427cb4654/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/fc63aebd-9b64-45a5-970c-d07427cb4654/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/f2c873d03406984c8618bb57b71e255f3861243e86e605fbda63701a780561c3/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/4306f0132951c5b78eae78720ead74b90832e6c56d09b14f217a2da007537557/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/e652f60fe3ee6ecab8df955a425122d56d3da0aa3414a1fc3870ae873e258045/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/3cd359b203ef70aede83ab24bd9403d9d9222e4f684cefa3c808bcc427be66bc/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/bc0a41536534def665baf3c32ff05d7744af7e8daf98965e4b5c95684e51d474/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-110:{mountpoint:/var/lib/containers/storage/overlay/c4b7b3022faba5e629d8c62bcdada6c701c9ee70094ee54e15b9ba83d16ac330/merged major:0 minor:110 fsType:overlay blockSize:0} overlay_0-121:{mountpoint:/var/lib/containers/storage/overlay/76f3994ddfd87980161dee78066c8528fb7001ae6138e768f12cfad0e0cfb78f/merged major:0 minor:121 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/f31181ba7875ff5f87434d0db461c6397584f2893ff9b282b5d1d9185a5fb48b/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/e360352b13257cb89b3986e4937efefd8e1adbd4994e0d9335ff229bd895a35e/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/501754e0b5499fd53c63b9690c30a8409af5d83ab9199323e3f766e7b12f38a6/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/cc07296c52c891b970efc2f34597c4ccbf5d6fdd3520fcc7fd44f601371ec368/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/393e5c7c78dbab2f83559e6983a2a30d459748dadcdde6264a15ac93f6ddc58b/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/1debe82a3bca2bfc1f62ebd78ec3248d9afd5604dc58ffe097633eef255c61d7/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/4ebab6279568a4b3b986e25411b56029f50d214bac54d2744174f570afa2be97/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/8fe376f00f3f844f48d74bc4fb7552cae478a82a77a68d2da70194c5ad0e7fad/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/3b1604512a936e7cb9144e158d5d7f8e4d453be591999d106df5341684492640/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/f5bd2d64895d3d30eacc924c9e506811f931883567a9ddbc7253a7a02775bcc5/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/42418662bad5ca91e5e267959c39c8a623a53620a214bde677d3bac251b96ab5/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/cad3340ac92c095b4cf61cd95b1ee0c53615ad8aae8471a237f64a13a86187a1/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/e079852d27a5ee4f5ccec749fdbc235b7937370508d49f09ed74e513d72688dc/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-188:{mountpoint:/var/lib/containers/storage/overlay/b7d739f61a99d6dca89464b148231fbee385632b8215b704ef7be089a739310e/merged major:0 minor:188 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/728fa1b1adf5aa4e7548606b52085a0036acccca655e27b18b4888b46ffe1292/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/9b2066b7d1d8dc2653b550bebb562bc80e0ca66922a82e774091de5d01b5a323/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/cd96352cd09f0f0379a28a3327ae9951d87e7093f75d38b15fed30a4d56a3605/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/0918cf8117f880668cdbfe026fe2f2e5493a36ec1eb6eed6240eaaf93971bfa2/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/47bed13777d3a7a001380f553ad38629d5fc94ba3f8670e082920714e8964d61/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/1ee8e91009179ed514b48caa8dda57fd5778b41c224cf3d5f67cf0204ebb2c07/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/c7c34d3979ae939a5918f5491f5a95ef08cb7034dada78b5b7f9af6dbfbf6974/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/c7970cdb236d0ea8f49c27c1890019680679bffdabe96936cb4d2e9f1d81767e/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/c52759a4ff1f76f288bf8bb860446a11e2f236122ee67f6cd7bdfd8a580414fd/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/5097ce7688328447a906838bc0450b767c1450e370ad0111c2fa8930310d186e/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/31d4f97d2d1bf5d0a41f40a478d40f3b5ffafd90497b43c7cb9522783ea649a2/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/6819353ac079e7e822e0aa4ff82bc865171e312ca70ed6c71a362748504fef93/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/4ac5083c96721be0e250bcfc12d17ea43f1921a8625ae2ca45c1a68e694a8b58/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-273:{mountpoint:/var/lib/containers/storage/overlay/56188cabc345604b5fd71c54cf4e051c7a6b1b095a732958b6e04b2ff017b8c3/merged major:0 minor:273 fsType:overlay blockSize:0} overlay_0-275:{mountpoint:/var/lib/containers/storage/overlay/7160cc004596c9e24a26a79a90693ac28dfd7f1d6d15cddc9dbf5d5410e9265c/merged major:0 minor:275 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/6f092ba0343377d815fd8942bcab1a6f386f3a29e6ab8ddce28b729895768fd2/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/84f576a5b43c45fb538bd85f6ad884263549af53ced179ff52b6c2753a67f6b5/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-318:{mountpoint:/var/lib/containers/storage/overlay/79d34564509e1026a04c123c280d80918e9961a957ba7a4fbb2c29e0c22fd003/merged major:0 minor:318 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/dd5d4117e4461deee369cf3ce69a77df60cc89f6740714a4fee1853e79f61163/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/de121e5802e0304632d7985701ae0b09a22520968f29ac62a3a38adf9739a8ce/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/75653aa36ce0bdb8d1ee034c914be49786c03e743e3840f1e33c9fb0b7f83611/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-333:{mountpoint:/var/lib/containers/storage/overlay/734ea5037e24cc92ebe8846516974b9c6995a2d30133f7e703f9bb71a400aa31/merged major:0 minor:333 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/cf0af828bc0c8557f400da241f690889e03f4bde55e2dc53c233a25bdd7c46ad/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/650c1bcbfcf7ea4d76ab293fd76c07e34a3f273b862b23e4410e8ec565fc6e28/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-359:{mountpoint:/var/lib/containers/storage/overlay/87e530034f0ea18b84cfb9544cdf2b0e5e5692723f0dfc25febdce18bdc08dc3/merged major:0 minor:359 fsType:overlay blockSize:0} overlay_0-361:{mountpoint:/var/lib/containers/storage/overlay/bbf94da18a2716f4b76938c34f0fba18f1f26cec6d306552bdc27f1310a710d3/merged major:0 minor:361 fsType:overlay blockSize:0} overlay_0-367:{mountpoint:/var/lib/containers/storage/overlay/78af534a90445b2d11dc88b5c737911e29bdbd4ec984c2b0768a38c388455f35/merged major:0 minor:367 fsType:overlay blockSize:0} overlay_0-372:{mountpoint:/var/lib/containers/storage/overlay/28402fe052460e6555d81e14dd22bd20aaae5aeccfaa457260d55742fe542898/merged major:0 minor:372 fsType:overlay blockSize:0} overlay_0-377:{mountpoint:/var/lib/containers/storage/overlay/c087a215f06c7a016203d9dca2b65dcb850417df83f6677f4afc76ea1a550da3/merged major:0 minor:377 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/afdbf7413af9009245996fde7314fdd9d561265407d4e1db1dc3f89cf9c2b519/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-385:{mountpoint:/var/lib/containers/storage/overlay/325445247ed9e9d9f02b4e199e7cdf693f4ca0aabc01cea0ed61d46d591e1099/merged major:0 minor:385 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/a01f57ad14c599348b54b0546a65c3d24e6e2e6b57aa17cdb9a23296e4f688ad/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-395:{mountpoint:/var/lib/containers/storage/overlay/e24b4e5e42662a6cb88716f83fb9f0da9d83bae21b00af6477819dc02e3d3c2d/merged major:0 minor:395 fsType:overlay blockSize:0} overlay_0-400:{mountpoint:/var/lib/containers/storage/overlay/b8b100820b99f2b7c5d69f2c54dd30cf7677d6bec477d8645c6f64e7e18579ac/merged major:0 minor:400 fsType:overlay blockSize:0} overlay_0-405:{mountpoint:/var/lib/containers/storage/overlay/60da8a5fcf08e8a2ddb80ba7cfb6fa33d7ea77adb18535114b1c594a2862f2c8/merged major:0 minor:405 fsType:overlay blockSize:0} overlay_0-406:{mountpoint:/var/lib/containers/storage/overlay/1e064b919a5f63afa3b3079608c0839b5fcddc3ae593bc791e047bf4a26bb81c/merged major:0 minor:406 fsType:overlay blockSize:0} overlay_0-417:{mountpoint:/var/lib/containers/storage/overlay/cd752d2db9612439ab45b058d4e2bd65113a370c8ba201575732aa6c84ffdc5b/merged major:0 minor:417 fsType:overlay blockSize:0} overlay_0-422:{mountpoint:/var/lib/containers/storage/overlay/8e2bd9cddab63dada110ee03b60421c42a5faca76d5f8ce4e104a07f3c274935/merged major:0 minor:422 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/3fba577cf64f6f9a593e03f222da3ae437c5d90d2c4fe40f4234135e3a96648f/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/7a94c4c29baefb25bf28d913dca487be477ba79ab1107c43fc09fcc19670865b/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-437:{mountpoint:/var/lib/containers/storage/overlay/1eaf304d1c1412bf7583a74d51b380f1989cd7285c60555013443bf17e348ac1/merged major:0 minor:437 fsType:overlay blockSize:0} overlay_0-443:{mountpoint:/var/lib/containers/storage/overlay/c4112f948bd3c6830e0d9e3fdfc39f801b637f97c2b1b946e09b61a4a5a0cbad/merged major:0 minor:443 fsType:overlay blockSize:0} overlay_0-465:{mountpoint:/var/lib/containers/storage/overlay/ad92b46b934d37bde41a3819c0b2c24ee0dd61e7ab4015ef6fdcd2be8f8bd034/merged major:0 minor:465 fsType:overlay blockSize:0} overlay_0-467:{mountpoint:/var/lib/containers/storage/overlay/dc8c21f4dd672eae88f0624472a2a787ef610fa077967f2a6d63703fdcbed20e/merged major:0 minor:467 fsType:overlay blockSize:0} overlay_0-469:{mountpoint:/var/lib/containers/storage/overlay/4c0d1ef9f444cec4ce81297dd8a150e9fa85c81a86ae1a8e1c2cb5a155dcf890/merged major:0 minor:469 fsType:overlay blockSize:0} overlay_0-475:{mountpoint:/var/lib/containers/storage/overlay/8fe11b0db4bc3cc438e7e6d0ac90f4e475c38aaed38d90c8043f05a911c37e3d/merged major:0 minor:475 fsType:overlay blockSize:0} overlay_0-480:{mountpoint:/var/lib/containers/storage/overlay/2058ca5ed7e91bd6a5046fddc5d3da6c3e61da0508c2cf521083f0cbbefd23a8/merged major:0 minor:480 fsType:overlay blockSize:0} overlay_0-485:{mountpoint:/var/lib/containers/storage/overlay/85803501f50ff93b61e99959ae1668793ef44980bf88aff05209b4287f4b9a1b/merged major:0 minor:485 fsType:overlay blockSize:0} overlay_0-490:{mountpoint:/var/lib/containers/storage/overlay/901c44307d6b9fd6ff59f8db5e5951b56b45a3691a5916340ad2993f1e19fd2e/merged major:0 minor:490 fsType:overlay blockSize:0} overlay_0-507:{mountpoint:/var/lib/containers/storage/overlay/ce44e1e002d1af1838d8b1c4ad89ee95136b5dd3ad6bca4ebc11f3385a837517/merged major:0 minor:507 fsType:overlay blockSize:0} overlay_0-509:{mountpoint:/var/lib/containers/storage/overlay/c54b7afe6a77c781dfb4cc0b12b26198562864776aa0383a687a984adfdba7f3/merged major:0 minor:509 fsType:overlay blockSize:0} overlay_0-511:{mountpoint:/var/lib/containers/storage/overlay/1f77393a433098a5426ca7758ca05a7242ec398735d6310cf10ea296328d14a2/merged major:0 minor:511 fsType:overlay blockSize:0} overlay_0-513:{mountpoint:/var/lib/containers/storage/overlay/014ea3724523a947478bd4d4697ccebf09bbcf28d153d634846257a1915d9dff/merged major:0 minor:513 fsType:overlay blockSize:0} overlay_0-515:{mountpoint:/var/lib/containers/storage/overlay/f47844ccbc11aad8aed6a5a5ec7d22ea756d9c7c7908f60864ef733f854f8286/merged major:0 minor:515 fsType:overlay blockSize:0} overlay_0-521:{mountpoint:/var/lib/containers/storage/overlay/95e873b6d4aad861f1db1832000dad277e18b36e0423436a9e31878a64d991b1/merged major:0 minor:521 fsType:overlay blockSize:0} overlay_0-526:{mountpoint:/var/lib/containers/storage/overlay/95815474cf38dd033c9a32c690f5b905b762084f207df2d88e339949e7abcb48/merged major:0 minor:526 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/a82bb1d6c6cc4c18f752b3f72adab0ea92892b9d37456297fc56fd7443c362eb/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/1ff9a1b4cd9551e7b2cb3e42581453d793bb951cf3e1762412f4a134accf6889/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/592464c5e98ae37873ceaf7933890be95df4757a32d71275b504c2434feabb75/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/8e5842f8f6256b7d0a71d8ca1add586036823c570ee99d655adcd26213e9c01c/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/fa4d9ab15073dfe7367cb4125ca2b5c224d1655f4c025c62d8eebdde350689d4/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/c15031714c20b1722d0742b6fe704813dfa715e5cb2be9594b59909cc3ef62a9/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/4cafd259fa52b18feb1e4b6453965717c051b1d3bc12315a2f3c95a8bb567ed5/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/214c9acc28a3a3fab9c71e8ac3fe25b98ef51feaf451d683e1b606814dec1231/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/07b32e3a0128366e369445ed5668abbe2581f7fa37a8939816fdee78c4baf42c/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/7b2682eeca5b1a797f784e02ba55cfee8dc7150544f1e08882de5b10acd065f3/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 20:37:05.106073 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.105608    5937 manager.go:217] Machine: {Timestamp:2026-10-30 20:37:05.105109588 +0000 UTC m=+0.061124354 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108086 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27cf66c44c6d3e1cb620cf6a2abf04 SystemUUID:ec27cf66-c44c-6d3e-1cb6-20cf6a2abf04 BootID:98b64899-6290-4a26-ad62-0dbdcf353fb1 Filesystems:[{Device:overlay_0-121 DeviceMajor:0 DeviceMinor:121 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03bdd5a3-703a-4c94-bf8c-53987d38e2a9/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-406 DeviceMajor:0 DeviceMinor:406 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-417 DeviceMajor:0 DeviceMinor:417 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-509 DeviceMajor:0 DeviceMinor:509 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-526 DeviceMajor:0 DeviceMinor:526 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f70d096fe0e6e2c598f357a14c16a761c5e494954654251463e2530efa08a2b3/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:454 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fc63aebd-9b64-45a5-970c-d07427cb4654/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-437 DeviceMajor:0 DeviceMinor:437 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:297 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-490 DeviceMajor:0 DeviceMinor:490 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:48 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c7b1e837e336dcc848ef35a2964562c55682a198167807ddacc58004f22cde4a/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:300 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:312 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:314 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b/volumes/kubernetes.io~projected/kube-api-access-96tsr DeviceMajor:0 DeviceMinor:339 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/dfdeb085-46f5-41da-8759-3ec51cf47b90/volumes/kubernetes.io~projected/kube-api-access-2qq5k DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:298 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e56ca3e6ec65a65c84d9b04f11ba180b57a73d29d6a386bc3d552d908989d6f3/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fcb92f66ea3c5b19cc5c805482f74e613e8fa7f3a935582de0a015119ecb2bdb/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:293 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-361 DeviceMajor:0 DeviceMinor:361 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:454 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5/volumes/kubernetes.io~projected/kube-api-access-rjblj DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ef9c0987-5531-4120-9ad2-fc7124ee8d5d/volumes/kubernetes.io~projected/kube-api-access-cc7n7 DeviceMajor:0 DeviceMinor:241 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:311 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:338 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ad5deab8-b21e-49be-ba98-36639a81e88d/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:50 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8/volumes/kubernetes.io~projected/kube-api-access-dzz59 DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-443 DeviceMajor:0 DeviceMinor:443 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:459 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d1d1c31d6caebe147ff1a102fc878ee5217fd6ea9465ce96676d9138c5d18fda/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ef9c0987-5531-4120-9ad2-fc7124ee8d5d/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:240 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-275 DeviceMajor:0 DeviceMinor:275 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:455 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/12273a1e-7592-4750-a6e2-58855d489834/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:499 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8b0071e38686c1662fe21cce2d7cc4371f0fd6fd31136b871fbb8a9c3d637989/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1b353680-167d-4d3e-aa95-2ddbd90d7566/volumes/kubernetes.io~projected/kube-api-access-p7ctj DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~projected/kube-api-access-cd2kj DeviceMajor:0 DeviceMinor:301 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:341 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f1423826de9f5bc3ad8722e7a779d6cda553c83a8e05832d82e132f2f2b5865f/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ef9c0987-5531-4120-9ad2-fc7124ee8d5d/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:236 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f1788d1c-9101-4856-933c-199b6ced5caa/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:243 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6987d150-7d2e-425b-8408-a64895782e1d/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:244 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~projected/kube-api-access-z8lp7 DeviceMajor:0 DeviceMinor:345 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-395 DeviceMajor:0 DeviceMinor:395 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:47 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/dfdeb085-46f5-41da-8759-3ec51cf47b90/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:49 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-273 DeviceMajor:0 DeviceMinor:273 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:306 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-400 DeviceMajor:0 DeviceMinor:400 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:452 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:454 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-188 DeviceMajor:0 DeviceMinor:188 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f1788d1c-9101-4856-933c-199b6ced5caa/volumes/kubernetes.io~projected/kube-api-access-dnbz6 DeviceMajor:0 DeviceMinor:249 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-318 DeviceMajor:0 DeviceMinor:318 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:448 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-485 DeviceMajor:0 DeviceMinor:485 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/673d97b5a582ad4436152ba1940237f50f47c7ed11ae123b276421381675f07b/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ad8c1ccccb4a747d34f72f3688354bc8104c71b0901defb958d6238aa972cf5f/userdata/shm DeviceMajor:0 DeviceMinor:302 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:296 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~projected/kube-api-access-dm2w2 DeviceMajor:0 DeviceMinor:462 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7070a33d-27e6-4500-bf51-7902613dec6a/volumes/kubernetes.io~projected/kube-api-access-lhtbv DeviceMajor:0 DeviceMinor:51 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/01d5ffb9-a652-4d8f-89f5-9c4657fa3341/volumes/kubernetes.io~projected/kube-api-access-hb82j DeviceMajor:0 DeviceMinor:53 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/telemeter-client-tls DeviceMajor:0 DeviceMinor:353 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-475 DeviceMajor:0 DeviceMinor:475 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:297 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1b353680-167d-4d3e-aa95-2ddbd90d7566/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:310 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:453 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-507 DeviceMajor:0 DeviceMinor:507 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-513 DeviceMajor:0 DeviceMinor:513 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-367 DeviceMajor:0 DeviceMinor:367 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:454 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:299 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6987d150-7d2e-425b-8408-a64895782e1d/volumes/kubernetes.io~projected/kube-api-access-r5dk8 DeviceMajor:0 DeviceMinor:248 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:289 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:296 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6bcfa608-6980-494c-9f02-fb3ebeb52f28/volumes/kubernetes.io~projected/kube-api-access-lbtdv DeviceMajor:0 DeviceMinor:52 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/46d6e7ae9450ac38cf3972220ae17d8cf88a7a38e5efe3696204f1f37e7d7cf7/userdata/shm DeviceMajor:0 DeviceMinor:250 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-405 DeviceMajor:0 DeviceMinor:405 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:456 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:457 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:461 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/fc63aebd-9b64-45a5-970c-d07427cb4654/volumes/kubernetes.io~projected/kube-api-access-58nsn DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:294 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:313 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/14c6c75333837a81c13d0d347227e954b13f94b65cd3236e252cda0975daa97a/userdata/shm DeviceMajor:0 DeviceMinor:500 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2faebb4ce63ffbc70f8ccb958937772ce3575a8d4e997fd2a5a91e505476504d/userdata/shm DeviceMajor:0 DeviceMinor:503 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/31f6d10f8793f51df1e756087059bc0d418c34cf0bb97ba99003b68f6d429713/userdata/shm DeviceMajor:0 DeviceMinor:63 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-110 DeviceMajor:0 DeviceMinor:110 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03bdd5a3-703a-4c94-bf8c-53987d38e2a9/volumes/kubernetes.io~projected/kube-api-access-x5k2q DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-333 DeviceMajor:0 DeviceMinor:333 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/federate-client-tls DeviceMajor:0 DeviceMinor:352 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-480 DeviceMajor:0 DeviceMinor:480 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ecfdfd45ed4274379123a37009a2e79b6b5893230120165e75c58e184e16d818/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/f1788d1c-9101-4856-933c-199b6ced5caa/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:245 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d0e2c4d35ee9774599016a0414f234c0216bc44a9ee0f0ea944ceb45eb17d51/userdata/shm DeviceMajor:0 DeviceMinor:357 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-469 DeviceMajor:0 DeviceMinor:469 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c91d68e8-37c6-4a25-8da1-9917f47cdba7/volumes/kubernetes.io~projected/kube-api-access-gzws7 DeviceMajor:0 DeviceMinor:502 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-511 DeviceMajor:0 DeviceMinor:511 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:297 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/00b22f897fd1f4de08eab52a264722732f7a781875ff11736a7ee323bac71c18/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-465 DeviceMajor:0 DeviceMinor:465 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f36c08ff51693762bddd5986109190eabf824ae1da3e7f137a213e7597e474a1/userdata/shm DeviceMajor:0 DeviceMinor:505 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1ac6bb8422d4b689d837c90fffa6e9682bf2216158db194f52f965de06987ce8/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/41a7895da92cbf3614e603836a01ee207ba2bd4d6ae6fda219275055eddd6922/userdata/shm DeviceMajor:0 DeviceMinor:254 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d557873e8a0eb8d17920c150d8eb5d30593ab1b67770b9dc1779b47ae48a96a2/userdata/shm DeviceMajor:0 DeviceMinor:463 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-467 DeviceMajor:0 DeviceMinor:467 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-515 DeviceMajor:0 DeviceMinor:515 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/bcb1db90-2d6e-4d26-8289-a05a105a2144/volumes/kubernetes.io~projected/kube-api-access-ldmq2 DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9d6d8c24722058fe636ec19a07a2404a299f3dcc7f892fe7c391a60df62f8f21/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:460 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7070a33d-27e6-4500-bf51-7902613dec6a/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:495 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-521 DeviceMajor:0 DeviceMinor:521 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:295 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9361050c-c0f0-4eff-a31e-7fa06644b9b8/volumes/kubernetes.io~projected/kube-api-access-77jkc DeviceMajor:0 DeviceMinor:315 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-377 DeviceMajor:0 DeviceMinor:377 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/eec25890-c83c-47df-863f-6959537e5c05/volumes/kubernetes.io~projected/kube-api-access-82qk6 DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/16cb19a727c1c3be986f3e18a8262249beb959554bd4af36081fb65ba4424627/userdata/shm DeviceMajor:0 DeviceMinor:62 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0a5032bfa0e2e25fb0931e2219d8fd0adbbb177aaec3103d1a567255df5a6f62/userdata/shm DeviceMajor:0 DeviceMinor:316 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/secret-telemeter-client DeviceMajor:0 DeviceMinor:355 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~projected/kube-api-access-59nw9 DeviceMajor:0 DeviceMinor:356 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-422 DeviceMajor:0 DeviceMinor:422 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6dd39a2f-5ae7-4d35-b616-efe9eee803b9/volumes/kubernetes.io~projected/kube-api-access-xmkfc DeviceMajor:0 DeviceMinor:54 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1daa3d8-62fd-42cc-9621-dfd1606010ce/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:297 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/63cba104-6b8b-4503-91aa-724269bcf213/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:458 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6987d150-7d2e-425b-8408-a64895782e1d/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:242 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/434e2bd2119dcb3faa3d0ede2743fff1c26898d9756a6f04686fc497f463b234/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9c4067daa3f2daeac38cf4c8173401923fd1f5e4b7cf78164f9509bc97b8d573/userdata/shm DeviceMajor:0 DeviceMinor:346 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/volumes/kubernetes.io~secret/secret-telemeter-client-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:354 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-385 DeviceMajor:0 DeviceMinor:385 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dfdeb085-46f5-41da-8759-3ec51cf47b90/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:342 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:343 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-359 DeviceMajor:0 DeviceMinor:359 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-372 DeviceMajor:0 DeviceMinor:372 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:00b22f897fd1f4d MacAddress:f6:d1:e6:88:9a:35 Speed:10000 Mtu:8901} {Name:0a5032bfa0e2e25 MacAddress:a6:ad:f7:9b:0d:e0 Speed:10000 Mtu:8901} {Name:14c6c75333837a8 MacAddress:c6:e6:fa:5d:46:b2 Speed:10000 Mtu:8901} {Name:2d0e2c4d35ee977 MacAddress:96:df:77:d5:06:b6 Speed:10000 Mtu:8901} {Name:2faebb4ce63ffbc MacAddress:52:24:70:aa:6b:8c Speed:10000 Mtu:8901} {Name:41a7895da92cbf3 MacAddress:9a:57:32:b9:1c:b9 Speed:10000 Mtu:8901} {Name:434e2bd2119dcb3 MacAddress:d6:50:41:ab:0a:9b Speed:10000 Mtu:8901} {Name:9c4067daa3f2dae MacAddress:c2:3a:5d:13:2d:a7 Speed:10000 Mtu:8901} {Name:9d6d8c24722058f MacAddress:8a:85:30:b2:d5:06 Speed:10000 Mtu:8901} {Name:ad8c1ccccb4a747 MacAddress:8a:f1:42:e6:b3:58 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:55:ec:40:62:93 Speed:0 Mtu:9001} {Name:br-int MacAddress:8a:54:08:a7:a7:2a Speed:0 Mtu:8901} {Name:d557873e8a0eb8d MacAddress:6e:90:87:42:fd:7c Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:55:ec:40:62:93 Speed:0 Mtu:9001} {Name:f36c08ff5169376 MacAddress:fa:aa:6c:07:5b:fc Speed:10000 Mtu:8901} {Name:f70d096fe0e6e2c MacAddress:36:1d:9e:47:2d:5c Speed:10000 Mtu:8901} {Name:fcb92f66ea3c5b1 MacAddress:16:fe:66:16:7b:96 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:ca:6b:4d:4d:a4:3f Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:72:48:e7:91:27:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 20:37:05.106314 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106078    5937 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 20:37:05.106314 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106122    5937 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 20:37:05.106420 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106398    5937 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 20:37:05.106567 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106421    5937 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-37.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 20:37:05.106611 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106569    5937 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 20:37:05.106611 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106577    5937 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 20:37:05.106611 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106591    5937 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:37:05.106611 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106610    5937 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 20:37:05.106719 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106702    5937 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 20:37:05.106855 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106846    5937 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 20:37:05.106966 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106958    5937 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 20:37:05.107002 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.106994    5937 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 20:37:05.107033 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.107010    5937 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 20:37:05.107033 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.107022    5937 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 20:37:05.107033 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.107030    5937 kubelet.go:405] "Adding apiserver pod source"
Oct 30 20:37:05.107126 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.107038    5937 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 20:37:05.108060 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.108046    5937 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:37:05.108060 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.108060    5937 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:37:05.108625 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.108604    5937 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 20:37:05.111359 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111340    5937 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 20:37:05.111359 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111356    5937 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 20:37:05.111601 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111493    5937 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 20:37:05.111771 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111756    5937 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 20:37:05.111832 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111797    5937 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 20:37:05.111925 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111914    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 20:37:05.111978 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111934    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 20:37:05.111978 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111944    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 20:37:05.111978 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111954    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 20:37:05.111978 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111964    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 20:37:05.111978 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111973    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 20:37:05.112213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111982    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 20:37:05.112213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.111990    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 20:37:05.112213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.112003    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 20:37:05.112213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.112012    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 20:37:05.112213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.112033    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 20:37:05.112213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.112048    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 20:37:05.112213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.112081    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 20:37:05.112213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.112091    5937 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 20:37:05.115616 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.115596    5937 server.go:1263] "Started kubelet"
Oct 30 20:37:05.115787 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.115713    5937 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 20:37:05.115840 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.115815    5937 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 20:37:05.117245 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.115674    5937 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 20:37:05.117245 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.116133    5937 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 20:37:05.116113 ip-10-0-141-37 systemd[1]: Started Kubernetes Kubelet.
Oct 30 20:37:05.117474 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.117397    5937 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 20:37:05.122943 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.122176    5937 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 20:37:05.122943 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.122198    5937 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 20:37:05.122943 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.122251    5937 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 20:30:55 +0000 UTC" deadline="2028-06-14 18:40:21.353474715 +0000 UTC"
Oct 30 20:37:05.122943 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.122270    5937 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14230h3m16.231207937s"
Oct 30 20:37:05.122943 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:05.122318    5937 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-37.us-west-1.compute.internal\" not found"
Oct 30 20:37:05.122943 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.122735    5937 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 20:37:05.122943 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.122779    5937 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 20:37:05.123324 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.123050    5937 factory.go:55] Registering systemd factory
Oct 30 20:37:05.123324 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.123069    5937 factory.go:223] Registration of the systemd container factory successfully
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.123568    5937 factory.go:153] Registering CRI-O factory
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.123588    5937 factory.go:223] Registration of the crio container factory successfully
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.123630    5937 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.123647    5937 factory.go:103] Registering Raw factory
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.123662    5937 manager.go:1199] Started watching for new ooms in manager
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.123721    5937 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.124025    5937 manager.go:319] Starting recovery of all containers
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126313    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cb0dbc9-7c90-4df9-a53f-fb5a7163993a" volumeName="kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-client-ca-bundle" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126341    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126356    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcb1db90-2d6e-4d26-8289-a05a105a2144" volumeName="kubernetes.io/projected/bcb1db90-2d6e-4d26-8289-a05a105a2144-kube-api-access-ldmq2" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126364    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-kube-api-access-cd2kj" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126373    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6dd39a2f-5ae7-4d35-b616-efe9eee803b9" volumeName="kubernetes.io/projected/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kube-api-access-xmkfc" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126382    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eec25890-c83c-47df-863f-6959537e5c05" volumeName="kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126389    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef9c0987-5531-4120-9ad2-fc7124ee8d5d" volumeName="kubernetes.io/projected/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-kube-api-access-cc7n7" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126396    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1788d1c-9101-4856-933c-199b6ced5caa" volumeName="kubernetes.io/projected/f1788d1c-9101-4856-933c-199b6ced5caa-kube-api-access-dnbz6" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126405    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc63aebd-9b64-45a5-970c-d07427cb4654" volumeName="kubernetes.io/projected/fc63aebd-9b64-45a5-970c-d07427cb4654-kube-api-access-58nsn" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126412    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cb0dbc9-7c90-4df9-a53f-fb5a7163993a" volumeName="kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-metrics-server-audit-profiles" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126420    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b353680-167d-4d3e-aa95-2ddbd90d7566" volumeName="kubernetes.io/empty-dir/1b353680-167d-4d3e-aa95-2ddbd90d7566-data-volume" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126428    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b353680-167d-4d3e-aa95-2ddbd90d7566" volumeName="kubernetes.io/secret/1b353680-167d-4d3e-aa95-2ddbd90d7566-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126435    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813e0b08-c4e4-41e2-a7c5-a72e06aeecc2" volumeName="kubernetes.io/projected/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-kube-api-access-59nw9" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126442    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c91d68e8-37c6-4a25-8da1-9917f47cdba7" volumeName="kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126452    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126459    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cb0dbc9-7c90-4df9-a53f-fb5a7163993a" volumeName="kubernetes.io/projected/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-kube-api-access-z8lp7" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126467    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813e0b08-c4e4-41e2-a7c5-a72e06aeecc2" volumeName="kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126490    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dfdeb085-46f5-41da-8759-3ec51cf47b90" volumeName="kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126498    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1788d1c-9101-4856-933c-199b6ced5caa" volumeName="kubernetes.io/empty-dir/f1788d1c-9101-4856-933c-199b6ced5caa-volume-directive-shadow" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126505    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cb0dbc9-7c90-4df9-a53f-fb5a7163993a" volumeName="kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-client-certs" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126512    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126520    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-config-out" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126528    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6987d150-7d2e-425b-8408-a64895782e1d" volumeName="kubernetes.io/empty-dir/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-textfile" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126554    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9361050c-c0f0-4eff-a31e-7fa06644b9b8" volumeName="kubernetes.io/configmap/9361050c-c0f0-4eff-a31e-7fa06644b9b8-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126562    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fc63aebd-9b64-45a5-970c-d07427cb4654" volumeName="kubernetes.io/secret/fc63aebd-9b64-45a5-970c-d07427cb4654-cert" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126569    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03bdd5a3-703a-4c94-bf8c-53987d38e2a9" volumeName="kubernetes.io/empty-dir/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-tmp-dir" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126591    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03bdd5a3-703a-4c94-bf8c-53987d38e2a9" volumeName="kubernetes.io/projected/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-kube-api-access-x5k2q" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126599    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126612    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad5deab8-b21e-49be-ba98-36639a81e88d" volumeName="kubernetes.io/secret/ad5deab8-b21e-49be-ba98-36639a81e88d-agent-certs" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126621    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12273a1e-7592-4750-a6e2-58855d489834" volumeName="kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126629    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b353680-167d-4d3e-aa95-2ddbd90d7566" volumeName="kubernetes.io/projected/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-api-access-p7ctj" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126636    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126644    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-kube-api-access-dm2w2" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126653    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dfdeb085-46f5-41da-8759-3ec51cf47b90" volumeName="kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-env-overrides" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126661    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eec25890-c83c-47df-863f-6959537e5c05" volumeName="kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126669    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126676    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813e0b08-c4e4-41e2-a7c5-a72e06aeecc2" volumeName="kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126684    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9361050c-c0f0-4eff-a31e-7fa06644b9b8" volumeName="kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126691    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813e0b08-c4e4-41e2-a7c5-a72e06aeecc2" volumeName="kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126698    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813e0b08-c4e4-41e2-a7c5-a72e06aeecc2" volumeName="kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126710    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dfdeb085-46f5-41da-8759-3ec51cf47b90" volumeName="kubernetes.io/projected/dfdeb085-46f5-41da-8759-3ec51cf47b90-kube-api-access-2qq5k" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126722    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-web-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126734    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eec25890-c83c-47df-863f-6959537e5c05" volumeName="kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126757    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-volume" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126764    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef9c0987-5531-4120-9ad2-fc7124ee8d5d" volumeName="kubernetes.io/configmap/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126771    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="35c58089-5fe0-4d5b-bd1a-a35fed0fabf8" volumeName="kubernetes.io/projected/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-kube-api-access-dzz59" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126780    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-tls-assets" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126789    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-web-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126797    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9361050c-c0f0-4eff-a31e-7fa06644b9b8" volumeName="kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126805    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01d5ffb9-a652-4d8f-89f5-9c4657fa3341" volumeName="kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cni-binary-copy" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126813    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cb0dbc9-7c90-4df9-a53f-fb5a7163993a" volumeName="kubernetes.io/empty-dir/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-audit-log" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126820    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bcfa608-6980-494c-9f02-fb3ebeb52f28" volumeName="kubernetes.io/projected/6bcfa608-6980-494c-9f02-fb3ebeb52f28-kube-api-access-lbtdv" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126828    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01d5ffb9-a652-4d8f-89f5-9c4657fa3341" volumeName="kubernetes.io/projected/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-kube-api-access-hb82j" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126848    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9361050c-c0f0-4eff-a31e-7fa06644b9b8" volumeName="kubernetes.io/projected/9361050c-c0f0-4eff-a31e-7fa06644b9b8-kube-api-access-77jkc" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126855    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126864    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126879    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7070a33d-27e6-4500-bf51-7902613dec6a" volumeName="kubernetes.io/projected/7070a33d-27e6-4500-bf51-7902613dec6a-kube-api-access-lhtbv" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126886    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9361050c-c0f0-4eff-a31e-7fa06644b9b8" volumeName="kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-grpc-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126895    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126902    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e6b8956c-da77-4dbd-b8d4-4d3b31c487a5" volumeName="kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-tuned" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126910    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126918    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03bdd5a3-703a-4c94-bf8c-53987d38e2a9" volumeName="kubernetes.io/secret/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-metrics-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126926    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15ec14b2-fe21-4c77-b9ed-6bf134a5e38b" volumeName="kubernetes.io/projected/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-kube-api-access-96tsr" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126933    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1b353680-167d-4d3e-aa95-2ddbd90d7566" volumeName="kubernetes.io/configmap/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126941    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6987d150-7d2e-425b-8408-a64895782e1d" volumeName="kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126950    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-metrics-client-certs" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126956    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813e0b08-c4e4-41e2-a7c5-a72e06aeecc2" volumeName="kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-client-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126964    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-tls-assets" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126972    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126980    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-db" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126988    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dfdeb085-46f5-41da-8759-3ec51cf47b90" volumeName="kubernetes.io/secret/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.126996    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-grpc-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127003    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6987d150-7d2e-425b-8408-a64895782e1d" volumeName="kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127018    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01d5ffb9-a652-4d8f-89f5-9c4657fa3341" volumeName="kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-daemon-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127025    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6987d150-7d2e-425b-8408-a64895782e1d" volumeName="kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127031    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813e0b08-c4e4-41e2-a7c5-a72e06aeecc2" volumeName="kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127039    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127046    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e6b8956c-da77-4dbd-b8d4-4d3b31c487a5" volumeName="kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-tmp" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127054    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cb0dbc9-7c90-4df9-a53f-fb5a7163993a" volumeName="kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127066    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6987d150-7d2e-425b-8408-a64895782e1d" volumeName="kubernetes.io/projected/6987d150-7d2e-425b-8408-a64895782e1d-kube-api-access-r5dk8" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127078    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9361050c-c0f0-4eff-a31e-7fa06644b9b8" volumeName="kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127089    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eec25890-c83c-47df-863f-6959537e5c05" volumeName="kubernetes.io/projected/eec25890-c83c-47df-863f-6959537e5c05-kube-api-access-82qk6" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127099    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef9c0987-5531-4120-9ad2-fc7124ee8d5d" volumeName="kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127109    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1788d1c-9101-4856-933c-199b6ced5caa" volumeName="kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127120    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dfdeb085-46f5-41da-8759-3ec51cf47b90" volumeName="kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127131    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1788d1c-9101-4856-933c-199b6ced5caa" volumeName="kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-metrics-client-ca" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127139    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127145    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="813e0b08-c4e4-41e2-a7c5-a72e06aeecc2" volumeName="kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-federate-client-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127153    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127160    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="35c58089-5fe0-4d5b-bd1a-a35fed0fabf8" volumeName="kubernetes.io/configmap/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-serviceca" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127167    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-out" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127174    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e6b8956c-da77-4dbd-b8d4-4d3b31c487a5" volumeName="kubernetes.io/projected/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-kube-api-access-rjblj" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127182    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127189    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7070a33d-27e6-4500-bf51-7902613dec6a" volumeName="kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127196    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9361050c-c0f0-4eff-a31e-7fa06644b9b8" volumeName="kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127204    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-main-db" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127211    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="15ec14b2-fe21-4c77-b9ed-6bf134a5e38b" volumeName="kubernetes.io/secret/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-monitoring-plugin-cert" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127219    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bcfa608-6980-494c-9f02-fb3ebeb52f28" volumeName="kubernetes.io/empty-dir/6bcfa608-6980-494c-9f02-fb3ebeb52f28-tmp-dir" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127226    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad5deab8-b21e-49be-ba98-36639a81e88d" volumeName="kubernetes.io/configmap/ad5deab8-b21e-49be-ba98-36639a81e88d-konnectivity-ca" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127233    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03bdd5a3-703a-4c94-bf8c-53987d38e2a9" volumeName="kubernetes.io/configmap/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-config-volume" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127241    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9361050c-c0f0-4eff-a31e-7fa06644b9b8" volumeName="kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127248    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127255    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9361050c-c0f0-4eff-a31e-7fa06644b9b8" volumeName="kubernetes.io/empty-dir/9361050c-c0f0-4eff-a31e-7fa06644b9b8-tmp" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127262    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127268    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef9c0987-5531-4120-9ad2-fc7124ee8d5d" volumeName="kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127275    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1788d1c-9101-4856-933c-199b6ced5caa" volumeName="kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127283    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f1788d1c-9101-4856-933c-199b6ced5caa" volumeName="kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127290    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0cb0dbc9-7c90-4df9-a53f-fb5a7163993a" volumeName="kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127297    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bcb1db90-2d6e-4d26-8289-a05a105a2144" volumeName="kubernetes.io/configmap/bcb1db90-2d6e-4d26-8289-a05a105a2144-iptables-alerter-script" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127305    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127312    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="63cba104-6b8b-4503-91aa-724269bcf213" volumeName="kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127319    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6987d150-7d2e-425b-8408-a64895782e1d" volumeName="kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-tls" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127339    5937 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1daa3d8-62fd-42cc-9621-dfd1606010ce" volumeName="kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-cluster-tls-config" seLinuxMountContext=""
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127347    5937 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 20:37:05.127653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.127352    5937 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 20:37:05.153273 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.153244    5937 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 20:37:05.154818 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.154792    5937 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 20:37:05.154818 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.154817    5937 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 20:37:05.154924 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.154841    5937 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 20:37:05.154924 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:05.154882    5937 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 20:37:05.164828 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.164803    5937 generic.go:356] "Generic (PLEG): container finished" podID="6987d150-7d2e-425b-8408-a64895782e1d" containerID="5a74e3e5db9026a19ba3d1db6d5903131e593e2957a467d5409a11f621e24e77" exitCode=0
Oct 30 20:37:05.176612 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.176582    5937 generic.go:356] "Generic (PLEG): container finished" podID="0ba69adc38a43ac678113498090bd571" containerID="6aa9f6d8bc00744db029461666a045f728737520e9fa42677084eeef2548c79f" exitCode=0
Oct 30 20:37:05.200915 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.200890    5937 generic.go:356] "Generic (PLEG): container finished" podID="63cba104-6b8b-4503-91aa-724269bcf213" containerID="4573f63174bcfe5d64d01e9b8cba08164849d68ec689c68599c697856f4bdba8" exitCode=0
Oct 30 20:37:05.212581 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.212531    5937 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="b9e414cb9145d115348917cb934ac26fab5cd8145463cc87957d9196fde7b18a" exitCode=0
Oct 30 20:37:05.212581 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.212580    5937 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="66d301d5a897d288e54de42ab02015b3d7b8ee9d940e096ef05e24878bf5e553" exitCode=0
Oct 30 20:37:05.212782 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.212588    5937 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="4e777f852b34fbd7c2ed25519600027e6e0e47f05c5954bad7f85a67b7231863" exitCode=0
Oct 30 20:37:05.212782 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.212596    5937 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="892358ac4b62093c1beb09b3e291ab1b82a1657fbb55db50a59495dbe8c483c6" exitCode=0
Oct 30 20:37:05.212782 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.212602    5937 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="c78103952178d405e42a77eb88fded3bdbba2df9e486cfdf203bda5575f1747d" exitCode=0
Oct 30 20:37:05.212782 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.212609    5937 generic.go:356] "Generic (PLEG): container finished" podID="eec25890-c83c-47df-863f-6959537e5c05" containerID="8b9d07379728f3ddf19a96613fe3e4727e6ed3e51e9579aa6c1b1a9e9f08578f" exitCode=0
Oct 30 20:37:05.222949 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:05.222923    5937 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-141-37.us-west-1.compute.internal\" not found"
Oct 30 20:37:05.225689 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.225662    5937 generic.go:356] "Generic (PLEG): container finished" podID="e1daa3d8-62fd-42cc-9621-dfd1606010ce" containerID="7201f00ca7171606280f6d37f82236a5381ab191574165f9211ecca4b11d89b0" exitCode=0
Oct 30 20:37:05.253784 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.253733    5937 manager.go:324] Recovery completed
Oct 30 20:37:05.254977 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:05.254957    5937 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 30 20:37:05.276052 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.276035    5937 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:05.278262 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.278245    5937 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:05.278346 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.278275    5937 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:05.278346 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.278288    5937 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:05.281102 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281085    5937 cpu_manager.go:226] "Starting" policy="none"
Oct 30 20:37:05.281102 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281100    5937 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:05.281242 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281101    5937 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 20:37:05.281242 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281181    5937 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 20:37:05.281310 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281294    5937 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 20:37:05.281345 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281305    5937 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 20:37:05.281345 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281322    5937 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 20:37:05.281345 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281327    5937 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 20:37:05.281345 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281333    5937 policy_none.go:50] "Start"
Oct 30 20:37:05.281345 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281344    5937 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 20:37:05.281496 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281353    5937 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 20:37:05.281496 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281466    5937 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 20:37:05.281496 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281473    5937 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 20:37:05.281496 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.281479    5937 policy_none.go:44] "Start"
Oct 30 20:37:05.284233 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.284207    5937 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:05.284348 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.284251    5937 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:05.284348 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.284291    5937 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:05.288764 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.288729    5937 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 20:37:05.291394 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.291382    5937 manager.go:341] "Starting Device Plugin manager"
Oct 30 20:37:05.291477 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:05.291411    5937 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 20:37:05.291477 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.291421    5937 server.go:87] "Starting device plugin registration server"
Oct 30 20:37:05.291700 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.291687    5937 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 20:37:05.291788 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.291699    5937 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 20:37:05.291870 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.291848    5937 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 20:37:05.291988 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.291952    5937 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 20:37:05.292066 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.291995    5937 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 20:37:05.292066 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.292002    5937 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 20:37:05.293093 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.292048    5937 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T20:37:05.29198614Z","UUID":"2678d985-8ed7-4ba4-9c65-701590e0b272","Handler":null,"Name":"","Endpoint":""}
Oct 30 20:37:05.294094 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:05.294076    5937 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 20:37:05.294242 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:05.294219    5937 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-37.us-west-1.compute.internal\" not found"
Oct 30 20:37:05.294242 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.294235    5937 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 20:37:05.294358 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.294263    5937 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 20:37:05.322826 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.322790    5937 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:05.323315 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.323302    5937 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 20:37:05.323485 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.323472    5937 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:05.323964 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.323935    5937 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:05.392024 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.392004    5937 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 20:37:05.393290 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.393275    5937 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 20:37:05.393387 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.393307    5937 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 20:37:05.393387 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.393322    5937 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-141-37.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 20:37:05.393387 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.393384    5937 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.424081 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.424061    5937 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 20:37:05.456061 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.456024    5937 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"]
Oct 30 20:37:05.456633 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.456602    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"0ba69adc38a43ac678113498090bd571","Type":"ContainerStarted","Data":"451271da1f9444d7c87e4b4c1384833e96247e74f7f2c18af55bf17c727bdac7"}
Oct 30 20:37:05.456698 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.456640    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"0ba69adc38a43ac678113498090bd571","Type":"ContainerDied","Data":"6aa9f6d8bc00744db029461666a045f728737520e9fa42677084eeef2548c79f"}
Oct 30 20:37:05.456698 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.456654    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"0ba69adc38a43ac678113498090bd571","Type":"ContainerStarted","Data":"8b0071e38686c1662fe21cce2d7cc4371f0fd6fd31136b871fbb8a9c3d637989"}
Oct 30 20:37:05.456698 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.456672    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"8b6a03677cd7bdfb119e5441f3717b20","Type":"ContainerStarted","Data":"2f5305659305bafed27ffd596a3a0588db486ed8ac4c2a0b760839a2c09ba77b"}
Oct 30 20:37:05.456698 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.456689    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal" event={"ID":"8b6a03677cd7bdfb119e5441f3717b20","Type":"ContainerStarted","Data":"16cb19a727c1c3be986f3e18a8262249beb959554bd4af36081fb65ba4424627"}
Oct 30 20:37:05.456846 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.456766    5937 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.456877 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.456848    5937 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.507064 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.507007    5937 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.507164 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.507072    5937 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.524477 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.524456    5937 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:37:05.524574 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:05.524493    5937 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.525176 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.525165    5937 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:37:05.525211 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:05.525188    5937 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.624532 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.624505    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.624631 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.624563    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b6a03677cd7bdfb119e5441f3717b20-config\") pod \"kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"8b6a03677cd7bdfb119e5441f3717b20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.624631 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.624617    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.725659 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.725636    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.725741 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.725662    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.725741 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.725679    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.725741 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.725699    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b6a03677cd7bdfb119e5441f3717b20-config\") pod \"kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"8b6a03677cd7bdfb119e5441f3717b20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.725741 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.725735    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b6a03677cd7bdfb119e5441f3717b20-config\") pod \"kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"8b6a03677cd7bdfb119e5441f3717b20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:05.725897 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:05.725786    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba69adc38a43ac678113498090bd571-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" (UID: \"0ba69adc38a43ac678113498090bd571\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:06.108017 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.107985    5937 apiserver.go:52] "Watching apiserver"
Oct 30 20:37:06.235338 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.235312    5937 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:06.235502 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.235457    5937 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:06.265336 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.265313    5937 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 20:37:06.266001 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.265982    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0","openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b","openshift-network-diagnostics/network-check-target-j7s49","openshift-insights/insights-runtime-extractor-42h66","openshift-multus/multus-hhmc8","kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal","openshift-multus/multus-additional-cni-plugins-r7zdg","openshift-monitoring/prometheus-k8s-0","kube-system/konnectivity-agent-qfhrk","openshift-monitoring/metrics-server-75fcff69cb-6r6fm","openshift-network-operator/iptables-alerter-2h449","openshift-ovn-kubernetes/ovnkube-node-7tj94","openshift-monitoring/telemeter-client-57d58748d4-z9zfx","openshift-monitoring/thanos-querier-ccf7bf59f-ssgss","openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v","openshift-multus/network-metrics-daemon-jwcss","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6","openshift-dns/dns-default-xrcmf","openshift-monitoring/node-exporter-4mlm5","kube-system/global-pull-secret-syncer-2r44p","openshift-ingress-canary/ingress-canary-2sj2r","openshift-cluster-node-tuning-operator/tuned-4sjbf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal","openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p","openshift-dns/node-resolver-cfhpb","openshift-image-registry/node-ca-f58ms"]
Oct 30 20:37:06.297257 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.297231    5937 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:37:06.297361 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:06.297276    5937 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:06.297798 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.297784    5937 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 20:37:06.297834 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:06.297818    5937 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:37:06.321863 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.321828    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-b4p7g\""
Oct 30 20:37:06.321863 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.321840    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 20:37:06.321996 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.321891    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 20:37:06.322092 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.322077    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-csvtm\""
Oct 30 20:37:06.322196 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.322181    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2mcfh\""
Oct 30 20:37:06.322397 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.322383    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-k65fh\""
Oct 30 20:37:06.322460 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.322421    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pdv7w\""
Oct 30 20:37:06.324842 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.324827    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 20:37:06.325025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325010    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8v9jn\""
Oct 30 20:37:06.325092 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325013    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqxsv\""
Oct 30 20:37:06.325092 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325031    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hbdn4\""
Oct 30 20:37:06.325533 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325517    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.325624 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325528    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.325658 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325645    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.325748 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325734    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k4gm7\""
Oct 30 20:37:06.325811 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325776    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.325874 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325823    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 20:37:06.325874 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.325822    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 20:37:06.326116 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326096    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 20:37:06.326116 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326098    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 20:37:06.326267 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326120    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.326267 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326120    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.326267 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326183    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.326267 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326193    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 20:37:06.326267 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326202    5937 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 20:37:06.326448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326299    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 20:37:06.326448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326308    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.326448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326312    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 20:37:06.326448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326334    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.326448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326347    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.326448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326349    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.326448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.326353    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.328567 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328531    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.328615 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328588    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b353680-167d-4d3e-aa95-2ddbd90d7566-crio-socket\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.328615 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328608    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.328695 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328656    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.328695 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328675    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm2w2\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-kube-api-access-dm2w2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.328695 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328693    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-env-overrides\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.328824 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328708    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-tls\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.328824 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328724    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcb1db90-2d6e-4d26-8289-a05a105a2144-host-slash\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:37:06.328928 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328855    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.328928 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328882    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-sys\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.328928 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328908    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-tuned\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.329035 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.328959    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.329035 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329018    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-tuned\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.329035 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329025    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-textfile\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.329124 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329111    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc63aebd-9b64-45a5-970c-d07427cb4654-cert\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:37:06.329163 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329148    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-textfile\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.329192 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329161    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.329192 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329173    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.329253 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329224    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96tsr\" (UniqueName: \"kubernetes.io/projected/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-kube-api-access-96tsr\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:37:06.329302 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329290    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-etc-kubernetes\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.329332 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329320    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtdv\" (UniqueName: \"kubernetes.io/projected/6bcfa608-6980-494c-9f02-fb3ebeb52f28-kube-api-access-lbtdv\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:37:06.329413 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329398    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-etc-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.329446 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329429    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.329483 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329453    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-metrics-client-ca\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.329483 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329471    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.329565 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329489    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.329565 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329517    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.329632 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329568    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-host\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.329632 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329584    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.329632 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329598    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-conf-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.329632 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329614    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-multus-certs\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.329632 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329631    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:37:06.329775 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329662    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.329775 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329685    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.329775 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329704    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzz59\" (UniqueName: \"kubernetes.io/projected/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-kube-api-access-dzz59\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:37:06.329857 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329792    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovn-node-metrics-cert\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.329857 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329822    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.329857 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329835    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.329857 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329845    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.330025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329873    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82qk6\" (UniqueName: \"kubernetes.io/projected/eec25890-c83c-47df-863f-6959537e5c05-kube-api-access-82qk6\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.330025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329895    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-serviceca\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:37:06.330025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329922    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-systemd-units\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.330025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329943    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-metrics-client-ca\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.330025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.329990    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.330025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330019    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnbz6\" (UniqueName: \"kubernetes.io/projected/f1788d1c-9101-4856-933c-199b6ced5caa-kube-api-access-dnbz6\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330036    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcb1db90-2d6e-4d26-8289-a05a105a2144-iptables-alerter-script\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330052    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-out\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330077    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9361050c-c0f0-4eff-a31e-7fa06644b9b8-metrics-client-ca\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330103    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-socket-dir-parent\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330136    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-wtmp\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330157    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-out\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330163    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330245    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcb1db90-2d6e-4d26-8289-a05a105a2144-iptables-alerter-script\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330249    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59nw9\" (UniqueName: \"kubernetes.io/projected/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-kube-api-access-59nw9\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.330308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330294    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cnibin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330334    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330350    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330366    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-client-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330385    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330409    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-run\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330432    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-config-out\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330471    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330491    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-config-out\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330495    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-serviceca\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330505    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-client-certs\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330567    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330575    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/eec25890-c83c-47df-863f-6959537e5c05-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330610    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-grpc-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330653    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330680    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-daemon-config\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330697    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.330718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330711    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-config\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330733    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-script-lib\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330758    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-sys\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330783    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77jkc\" (UniqueName: \"kubernetes.io/projected/9361050c-c0f0-4eff-a31e-7fa06644b9b8-kube-api-access-77jkc\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330811    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-federate-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330836    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-device-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330843    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-daemon-config\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330859    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-var-lib-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.330887    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-log-socket\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331002    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331059    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331088    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8lp7\" (UniqueName: \"kubernetes.io/projected/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-kube-api-access-z8lp7\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331224    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331271    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-kubelet\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331308    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bcfa608-6980-494c-9f02-fb3ebeb52f28-hosts-file\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331367    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-lib-modules\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331416    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.331487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331469    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331508    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-modprobe-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331558    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-conf\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331595    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc7n7\" (UniqueName: \"kubernetes.io/projected/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-kube-api-access-cc7n7\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331613    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331662    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-slash\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331701    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-ovn\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331740    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-metrics-tls\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331779    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-web-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331854    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331878    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb82j\" (UniqueName: \"kubernetes.io/projected/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-kube-api-access-hb82j\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331895    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331910    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7ctj\" (UniqueName: \"kubernetes.io/projected/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-api-access-p7ctj\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331927    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331942    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-multus\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331956    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-systemd\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.331975    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332010    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-cnibin\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332042    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332082    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-kubernetes\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332135    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7070a33d-27e6-4500-bf51-7902613dec6a-metrics-certs\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332146    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332203    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.332250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332240    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-kubelet-config\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332271    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad5deab8-b21e-49be-ba98-36639a81e88d-konnectivity-ca\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332296    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhtbv\" (UniqueName: \"kubernetes.io/projected/7070a33d-27e6-4500-bf51-7902613dec6a-kube-api-access-lhtbv\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332312    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-netns\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332338    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332448    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad5deab8-b21e-49be-ba98-36639a81e88d-konnectivity-ca\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332474    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332498    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-metrics-server-audit-profiles\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332555    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-kubelet\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332627    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldmq2\" (UniqueName: \"kubernetes.io/projected/bcb1db90-2d6e-4d26-8289-a05a105a2144-kube-api-access-ldmq2\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332652    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332722    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332735    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cni-binary-copy\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332765    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332790    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-host\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332886    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-config-volume\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332892    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cni-binary-copy\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332917    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5k2q\" (UniqueName: \"kubernetes.io/projected/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-kube-api-access-x5k2q\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332944    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-k8s-cni-cncf-io\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.332963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332960    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332976    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-system-cni-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.332994    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-root\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333014    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333054    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333148    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-bin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333188    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-dbus\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333238    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-audit-log\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333288    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-netd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333347    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd2kj\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-kube-api-access-cd2kj\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333359    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-audit-log\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333383    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysconfig\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333419    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjblj\" (UniqueName: \"kubernetes.io/projected/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-kube-api-access-rjblj\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333461    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333557    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333587    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-bin\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333604    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333626    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.333668 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333647    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333689    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333754    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333773    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5dk8\" (UniqueName: \"kubernetes.io/projected/6987d150-7d2e-425b-8408-a64895782e1d-kube-api-access-r5dk8\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333789    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nsn\" (UniqueName: \"kubernetes.io/projected/fc63aebd-9b64-45a5-970c-d07427cb4654-kube-api-access-58nsn\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333805    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-netns\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333819    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-hostroot\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333849    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcfa608-6980-494c-9f02-fb3ebeb52f28-tmp-dir\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333878    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333938    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bcfa608-6980-494c-9f02-fb3ebeb52f28-tmp-dir\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333959    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad5deab8-b21e-49be-ba98-36639a81e88d-agent-certs\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.333983    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334003    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qq5k\" (UniqueName: \"kubernetes.io/projected/dfdeb085-46f5-41da-8759-3ec51cf47b90-kube-api-access-2qq5k\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334020    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334079    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334097    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334113    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-node-log\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334136    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334192    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad5deab8-b21e-49be-ba98-36639a81e88d-agent-certs\") pod \"konnectivity-agent-qfhrk\" (UID: \"ad5deab8-b21e-49be-ba98-36639a81e88d\") " pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334212    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b353680-167d-4d3e-aa95-2ddbd90d7566-data-volume\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334233    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-serving-certs-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334251    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334275    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-tls\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334319    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-tmp-dir\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334341    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b353680-167d-4d3e-aa95-2ddbd90d7566-data-volume\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334348    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1788d1c-9101-4856-933c-199b6ced5caa-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.334365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334376    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334406    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-tmp-dir\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334407    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334446    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f1788d1c-9101-4856-933c-199b6ced5caa-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334455    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmkfc\" (UniqueName: \"kubernetes.io/projected/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kube-api-access-xmkfc\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334486    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-var-lib-kubelet\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334517    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-web-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334563    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-systemd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334583    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334602    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334619    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-system-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334638    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334691    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9361050c-c0f0-4eff-a31e-7fa06644b9b8-tmp\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334751    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334772    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-tmp\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334813    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334847    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9361050c-c0f0-4eff-a31e-7fa06644b9b8-tmp\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334874    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-tmp\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.335207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.334878    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b353680-167d-4d3e-aa95-2ddbd90d7566-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.339793 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.339778    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 20:37:06.339793 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.339780    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 20:37:06.339945 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.339934    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 20:37:06.340295 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.340285    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.340435 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.340421    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.340481 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.340439    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.340556 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.340521    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 20:37:06.340641 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.340630    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 20:37:06.341143 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.341128    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-config\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.341190 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.341174    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovnkube-script-lib\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.341365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.341352    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mx55q\""
Oct 30 20:37:06.341409 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.341398    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 30 20:37:06.341656 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.341645    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 20:37:06.341712 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.341700    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-2nx5p\""
Oct 30 20:37:06.341820 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.341809    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 20:37:06.341860 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.341828    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.341860 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.341834    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l8lvp\""
Oct 30 20:37:06.342242 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.342216    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-web-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.342580 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.342569    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-x2fjq\""
Oct 30 20:37:06.342580 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.342574    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 30 20:37:06.342980 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.342970    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q82tz\""
Oct 30 20:37:06.343020 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.343011    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 20:37:06.343092 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.343079    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 30 20:37:06.343227 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.343215    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.344345 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.344332    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.344923 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.344907    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.345054 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.345040    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:37:06.345084 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.345054    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wql4r\""
Oct 30 20:37:06.345150 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.345136    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1b353680-167d-4d3e-aa95-2ddbd90d7566-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.345357 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.345344    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 20:37:06.345946 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.345933    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.346401 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.346383    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.346464 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.346397    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.346464 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.346386    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.346597 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.346483    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:37:06.346597 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.346483    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 20:37:06.346678 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.346611    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 20:37:06.346678 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.346615    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 30 20:37:06.346678 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.346623    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 20:37:06.346985 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.346609    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 20:37:06.349268 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.349253    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dfdeb085-46f5-41da-8759-3ec51cf47b90-env-overrides\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.349307 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.349253    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.349307 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.349256    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.349383 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.349366    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc63aebd-9b64-45a5-970c-d07427cb4654-cert\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:37:06.349707 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.349690    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-metrics-client-ca\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.350879 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.350859    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.350930 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.350861    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-metrics-client-ca\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.350930 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.350868    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfdeb085-46f5-41da-8759-3ec51cf47b90-ovn-node-metrics-cert\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.351002 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.350958    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9361050c-c0f0-4eff-a31e-7fa06644b9b8-metrics-client-ca\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.351071 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.351058    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12273a1e-7592-4750-a6e2-58855d489834-original-pull-secret\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:37:06.352053 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.352040    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-metrics-tls\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:37:06.353185 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.353172    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-config-volume\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:37:06.354343 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.354330    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.355503 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.355491    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.376003 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.375927    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 30 20:37:06.376003 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.375943    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 30 20:37:06.376276 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.376253    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 30 20:37:06.376371 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.376336    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2nknl\""
Oct 30 20:37:06.376516 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.376501    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mk8vz\""
Oct 30 20:37:06.376583 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.376517    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 30 20:37:06.376809 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.376790    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 30 20:37:06.376903 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.376883    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 30 20:37:06.377210 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.377193    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 30 20:37:06.377261 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.377219    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 30 20:37:06.377638 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.377619    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5v6zk\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.377857    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.377897    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.377924    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378034    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378044    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fzf7s\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378092    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dz8l9\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378354    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378359    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378401    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2q2tq\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378506    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378694    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378702    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378752    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378794    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.378981    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379026    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379032    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 30 20:37:06.379208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379104    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379265    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-tls\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379270    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cgl3iiubi2irp\""
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379310    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379432    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379457    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pwzv\""
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379563    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-config-volume\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379632    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hrrpw\""
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379660    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379709    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379748    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.380022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.379846    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:37:06.381036 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.380999    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.381036 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.381022    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.381149 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.381041    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-client-certs\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.381149 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.381045    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-grpc-tls\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.381149 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.381141    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.381235 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.381177    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-federate-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.381324 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.381309    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.382303 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.382288    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.383433 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.383400    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:37:06.383433 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.383421    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.383576 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.383453    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-metrics-server-audit-profiles\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.384588 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.384566    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.384665 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.384563    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-client-tls\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.384665 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.384606    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:37:06.384665 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.384622    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.384665 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.384655    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.384961 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.384681    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9361050c-c0f0-4eff-a31e-7fa06644b9b8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.384961 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.384699    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.384961 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.384730    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-web-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.384961 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.384815    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1788d1c-9101-4856-933c-199b6ced5caa-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.385125 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.385010    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1daa3d8-62fd-42cc-9621-dfd1606010ce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.389078 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.389063    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e1daa3d8-62fd-42cc-9621-dfd1606010ce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.390642 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.390628    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 30 20:37:06.390705 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.390669    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 30 20:37:06.390982 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.390966    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 30 20:37:06.391052 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.391042    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 30 20:37:06.391659 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.391645    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.392165 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.392152    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.392336 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.392323    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.392461 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.392445    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7vtmti1uni647\""
Oct 30 20:37:06.392461 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.392456    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cp5qmlj8ebn7l\""
Oct 30 20:37:06.392550 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.392500    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Oct 30 20:37:06.393107 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.393082    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.393145 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.393115    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 30 20:37:06.393145 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.393132    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 30 20:37:06.393583 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.393568    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 30 20:37:06.393583 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.393573    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 30 20:37:06.393694 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.393581    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 30 20:37:06.394156 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.394142    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 30 20:37:06.394210 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.394157    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 30 20:37:06.394210 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.394158    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 30 20:37:06.394210 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.394171    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qvn7r\""
Oct 30 20:37:06.395338 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.395325    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.395338 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.395331    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-serving-certs-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.395416 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.395350    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-secret-metrics-server-tls\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.395416 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.395352    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-config\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.398292 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.398274    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 30 20:37:06.400623 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.400609    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-client-ca-bundle\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.400676 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.400621    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.400676 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.400608    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-secret-telemeter-client\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.401679 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.401659    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.401761 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.401675    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.401850 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.401835    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.402913 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.402896    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.403948 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.403932    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.404005 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.403951    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63cba104-6b8b-4503-91aa-724269bcf213-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.423738 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.423711    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.424254    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.424360    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtdv\" (UniqueName: \"kubernetes.io/projected/6bcfa608-6980-494c-9f02-fb3ebeb52f28-kube-api-access-lbtdv\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.424412    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhtbv\" (UniqueName: \"kubernetes.io/projected/7070a33d-27e6-4500-bf51-7902613dec6a-kube-api-access-lhtbv\") pod \"network-metrics-daemon-jwcss\" (UID: \"7070a33d-27e6-4500-bf51-7902613dec6a\") " pod="openshift-multus/network-metrics-daemon-jwcss"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.424570    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96tsr\" (UniqueName: \"kubernetes.io/projected/15ec14b2-fe21-4c77-b9ed-6bf134a5e38b-kube-api-access-96tsr\") pod \"monitoring-plugin-77f4f76594-vmk7p\" (UID: \"15ec14b2-fe21-4c77-b9ed-6bf134a5e38b\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.424571    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm2w2\" (UniqueName: \"kubernetes.io/projected/63cba104-6b8b-4503-91aa-724269bcf213-kube-api-access-dm2w2\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.424657    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc7n7\" (UniqueName: \"kubernetes.io/projected/ef9c0987-5531-4120-9ad2-fc7124ee8d5d-kube-api-access-cc7n7\") pod \"openshift-state-metrics-7bd7489957-ssh6v\" (UID: \"ef9c0987-5531-4120-9ad2-fc7124ee8d5d\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-ssh6v"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.424996    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7ctj\" (UniqueName: \"kubernetes.io/projected/1b353680-167d-4d3e-aa95-2ddbd90d7566-kube-api-access-p7ctj\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425007    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77jkc\" (UniqueName: \"kubernetes.io/projected/9361050c-c0f0-4eff-a31e-7fa06644b9b8-kube-api-access-77jkc\") pod \"thanos-querier-ccf7bf59f-ssgss\" (UID: \"9361050c-c0f0-4eff-a31e-7fa06644b9b8\") " pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425033    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8lp7\" (UniqueName: \"kubernetes.io/projected/0cb0dbc9-7c90-4df9-a53f-fb5a7163993a-kube-api-access-z8lp7\") pod \"metrics-server-75fcff69cb-6r6fm\" (UID: \"0cb0dbc9-7c90-4df9-a53f-fb5a7163993a\") " pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425055    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5dk8\" (UniqueName: \"kubernetes.io/projected/6987d150-7d2e-425b-8408-a64895782e1d-kube-api-access-r5dk8\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425231    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldmq2\" (UniqueName: \"kubernetes.io/projected/bcb1db90-2d6e-4d26-8289-a05a105a2144-kube-api-access-ldmq2\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425254    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59nw9\" (UniqueName: \"kubernetes.io/projected/813e0b08-c4e4-41e2-a7c5-a72e06aeecc2-kube-api-access-59nw9\") pod \"telemeter-client-57d58748d4-z9zfx\" (UID: \"813e0b08-c4e4-41e2-a7c5-a72e06aeecc2\") " pod="openshift-monitoring/telemeter-client-57d58748d4-z9zfx"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425288    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd2kj\" (UniqueName: \"kubernetes.io/projected/e1daa3d8-62fd-42cc-9621-dfd1606010ce-kube-api-access-cd2kj\") pod \"alertmanager-main-0\" (UID: \"e1daa3d8-62fd-42cc-9621-dfd1606010ce\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425426    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58nsn\" (UniqueName: \"kubernetes.io/projected/fc63aebd-9b64-45a5-970c-d07427cb4654-kube-api-access-58nsn\") pod \"ingress-canary-2sj2r\" (UID: \"fc63aebd-9b64-45a5-970c-d07427cb4654\") " pod="openshift-ingress-canary/ingress-canary-2sj2r"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425522    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82qk6\" (UniqueName: \"kubernetes.io/projected/eec25890-c83c-47df-863f-6959537e5c05-kube-api-access-82qk6\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.425592 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425526    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmkfc\" (UniqueName: \"kubernetes.io/projected/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kube-api-access-xmkfc\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.426254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425676    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5k2q\" (UniqueName: \"kubernetes.io/projected/03bdd5a3-703a-4c94-bf8c-53987d38e2a9-kube-api-access-x5k2q\") pod \"dns-default-xrcmf\" (UID: \"03bdd5a3-703a-4c94-bf8c-53987d38e2a9\") " pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:37:06.426254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425734    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb82j\" (UniqueName: \"kubernetes.io/projected/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-kube-api-access-hb82j\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.426254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425785    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnbz6\" (UniqueName: \"kubernetes.io/projected/f1788d1c-9101-4856-933c-199b6ced5caa-kube-api-access-dnbz6\") pod \"kube-state-metrics-5dc8d7d89b-c9q7b\" (UID: \"f1788d1c-9101-4856-933c-199b6ced5caa\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-c9q7b"
Oct 30 20:37:06.426254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425875    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzz59\" (UniqueName: \"kubernetes.io/projected/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-kube-api-access-dzz59\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:37:06.426254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425915    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjblj\" (UniqueName: \"kubernetes.io/projected/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-kube-api-access-rjblj\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.426254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.425937    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzws7\" (UniqueName: \"kubernetes.io/projected/c91d68e8-37c6-4a25-8da1-9917f47cdba7-kube-api-access-gzws7\") pod \"network-check-target-j7s49\" (UID: \"c91d68e8-37c6-4a25-8da1-9917f47cdba7\") " pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:37:06.426254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.426029    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qq5k\" (UniqueName: \"kubernetes.io/projected/dfdeb085-46f5-41da-8759-3ec51cf47b90-kube-api-access-2qq5k\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.432189 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.432165    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.434718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.434702    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63cba104-6b8b-4503-91aa-724269bcf213-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63cba104-6b8b-4503-91aa-724269bcf213\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:06.435314 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435299    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.435353 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435323    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-kubelet-config\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:37:06.435353 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435340    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-netns\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.435455 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435354    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.435455 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435369    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-kubelet\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.435455 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435383    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-host\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:37:06.435455 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435399    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-kubelet-config\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:37:06.435455 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435426    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-netns\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.435455 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435443    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-kubelet\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.435455 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435454    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435462    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-socket-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435430    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35c58089-5fe0-4d5b-bd1a-a35fed0fabf8-host\") pod \"node-ca-f58ms\" (UID: \"35c58089-5fe0-4d5b-bd1a-a35fed0fabf8\") " pod="openshift-image-registry/node-ca-f58ms"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435503    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-k8s-cni-cncf-io\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435532    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-system-cni-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435587    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-k8s-cni-cncf-io\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435598    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-root\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435625    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-bin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435626    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-system-cni-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435661    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-bin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435663    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-dbus\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435678    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-root\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435698    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-netd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435730    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysconfig\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435758    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-bin\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435764    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12273a1e-7592-4750-a6e2-58855d489834-dbus\") pod \"global-pull-secret-syncer-2r44p\" (UID: \"12273a1e-7592-4750-a6e2-58855d489834\") " pod="kube-system/global-pull-secret-syncer-2r44p"
Oct 30 20:37:06.435778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435773    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-netd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435795    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-netns\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435813    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-cni-bin\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435821    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-hostroot\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435829    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysconfig\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435849    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-netns\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435848    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435858    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-hostroot\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435880    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435881    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-node-log\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435909    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-node-log\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435920    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-var-lib-kubelet\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435940    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-systemd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435954    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-system-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435961    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-var-lib-kubelet\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.435970    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436002    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b353680-167d-4d3e-aa95-2ddbd90d7566-crio-socket\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436000    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436029    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-systemd\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436030    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcb1db90-2d6e-4d26-8289-a05a105a2144-host-slash\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436058    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1b353680-167d-4d3e-aa95-2ddbd90d7566-crio-socket\") pod \"insights-runtime-extractor-42h66\" (UID: \"1b353680-167d-4d3e-aa95-2ddbd90d7566\") " pod="openshift-insights/insights-runtime-extractor-42h66"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436064    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436065    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcb1db90-2d6e-4d26-8289-a05a105a2144-host-slash\") pod \"iptables-alerter-2h449\" (UID: \"bcb1db90-2d6e-4d26-8289-a05a105a2144\") " pod="openshift-network-operator/iptables-alerter-2h449"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436068    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-system-cni-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436092    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-sys\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436119    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-sys\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436120    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-etc-kubernetes\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436151    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-etc-kubernetes\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436161    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-etc-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436173    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436180    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436196    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436209    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-host\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436230    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436249    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436278    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-host\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436279    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-etc-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436282    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-conf-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436312    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-multus-certs\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436317    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-conf-dir\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436280    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436326    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436342    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-systemd-units\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436361    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-run-multus-certs\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436364    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436382    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-run-ovn-kubernetes\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436394    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-socket-dir-parent\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436414    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-wtmp\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436433    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-systemd-units\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.436415 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436440    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cnibin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436502    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-run\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436511    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-cnibin\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436434    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-multus-socket-dir-parent\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436548    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-sys\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436574    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-device-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436584    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-run\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436573    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-node-exporter-wtmp\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436597    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-var-lib-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436609    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6987d150-7d2e-425b-8408-a64895782e1d-sys\") pod \"node-exporter-4mlm5\" (UID: \"6987d150-7d2e-425b-8408-a64895782e1d\") " pod="openshift-monitoring/node-exporter-4mlm5"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436617    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-device-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436620    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-log-socket\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436641    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-var-lib-openvswitch\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436645    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-log-socket\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436668    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436698    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-kubelet\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436710    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-sys-fs\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436726    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bcfa608-6980-494c-9f02-fb3ebeb52f28-hosts-file\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436736    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-kubelet\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436748    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-lib-modules\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436772    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-modprobe-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436796    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-conf\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436834    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-slash\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436853    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-lib-modules\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436774    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6bcfa608-6980-494c-9f02-fb3ebeb52f28-hosts-file\") pod \"node-resolver-cfhpb\" (UID: \"6bcfa608-6980-494c-9f02-fb3ebeb52f28\") " pod="openshift-dns/node-resolver-cfhpb"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436859    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-ovn\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436874    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-host-slash\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436891    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-modprobe-d\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436899    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dfdeb085-46f5-41da-8759-3ec51cf47b90-run-ovn\") pod \"ovnkube-node-7tj94\" (UID: \"dfdeb085-46f5-41da-8759-3ec51cf47b90\") " pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436915    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436935    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-sysctl-conf\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436943    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-multus\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436966    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-systemd\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436966    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6dd39a2f-5ae7-4d35-b616-efe9eee803b9-registration-dir\") pod \"aws-ebs-csi-driver-node-6k8w6\" (UID: \"6dd39a2f-5ae7-4d35-b616-efe9eee803b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6k8w6"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.436967    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01d5ffb9-a652-4d8f-89f5-9c4657fa3341-host-var-lib-cni-multus\") pod \"multus-hhmc8\" (UID: \"01d5ffb9-a652-4d8f-89f5-9c4657fa3341\") " pod="openshift-multus/multus-hhmc8"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.437004    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-systemd\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.437011    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-cnibin\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.437041    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eec25890-c83c-47df-863f-6959537e5c05-cnibin\") pod \"multus-additional-cni-plugins-r7zdg\" (UID: \"eec25890-c83c-47df-863f-6959537e5c05\") " pod="openshift-multus/multus-additional-cni-plugins-r7zdg"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.437069    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-kubernetes\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.438004 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.437115    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6b8956c-da77-4dbd-b8d4-4d3b31c487a5-etc-kubernetes\") pod \"tuned-4sjbf\" (UID: \"e6b8956c-da77-4dbd-b8d4-4d3b31c487a5\") " pod="openshift-cluster-node-tuning-operator/tuned-4sjbf"
Oct 30 20:37:06.816523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:06.816492    5937 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:07.484287 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:07.484257    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xrcmf"
Oct 30 20:37:07.816298 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:07.816230    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-ccf7bf59f-ssgss"
Oct 30 20:37:07.889775 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:07.889743    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:09.098707 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:09.098673    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:37:10.076814 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:10.076781    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:37:10.382375 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:10.382306    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:10.382727 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:10.382567    5937 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 20:37:11.965719 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:11.965690    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7tj94"
Oct 30 20:37:14.794458 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:14.794380    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qfhrk"
Oct 30 20:37:15.671056 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:15.671024    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:37:15.951889 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:15.951821    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-vmk7p"
Oct 30 20:37:28.873284 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:28.873250    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75fcff69cb-6r6fm"
Oct 30 20:37:40.079992 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:37:40.079957    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j7s49"
Oct 30 20:37:45.671709 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:37:45.671672    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:38:06.835730 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:38:06.835701    5937 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:38:06.850716 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:38:06.850694    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 30 20:38:15.670767 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:38:15.670732    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:38:45.671268 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:38:45.671233    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:39:15.671958 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:39:15.671918    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:39:45.671343 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:39:45.671309    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:40:15.670986 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:40:15.670891    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:40:45.671556 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:40:45.671492    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:41:15.671178 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:41:15.671138    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:41:45.671177 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:41:45.671085    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:42:15.671692 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:42:15.671655    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:42:45.670295 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:42:45.670255    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:43:15.670925 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:43:15.670835    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:43:45.670604 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:43:45.670566    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:44:15.671458 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:44:15.671420    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:44:45.671269 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:44:45.671186    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:45:15.671033 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:45:15.670998    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:45:45.671105 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:45:45.671071    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:45:48.559677 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.559643    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"]
Oct 30 20:45:48.561773 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.561745    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"
Oct 30 20:45:48.623854 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.623831    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b60b939e-3a4f-42ec-95f6-18efc7792bff-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9\" (UID: \"b60b939e-3a4f-42ec-95f6-18efc7792bff\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"
Oct 30 20:45:48.624007 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.623872    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b60b939e-3a4f-42ec-95f6-18efc7792bff-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9\" (UID: \"b60b939e-3a4f-42ec-95f6-18efc7792bff\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"
Oct 30 20:45:48.627622 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.627601    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-observability-operator\"/\"obo-prometheus-operator-admission-webhook-service-cert\""
Oct 30 20:45:48.670391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.670366    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-observability-operator\"/\"obo-prometheus-operator-admission-webhook-dockercfg-6vnnw\""
Oct 30 20:45:48.671221 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.671197    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"]
Oct 30 20:45:48.725049 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.725024    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b60b939e-3a4f-42ec-95f6-18efc7792bff-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9\" (UID: \"b60b939e-3a4f-42ec-95f6-18efc7792bff\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"
Oct 30 20:45:48.725176 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.725089    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b60b939e-3a4f-42ec-95f6-18efc7792bff-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9\" (UID: \"b60b939e-3a4f-42ec-95f6-18efc7792bff\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"
Oct 30 20:45:48.725398 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.725381    5937 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 20:45:48.727561 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.727518    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b60b939e-3a4f-42ec-95f6-18efc7792bff-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9\" (UID: \"b60b939e-3a4f-42ec-95f6-18efc7792bff\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"
Oct 30 20:45:48.727656 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.727576    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b60b939e-3a4f-42ec-95f6-18efc7792bff-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9\" (UID: \"b60b939e-3a4f-42ec-95f6-18efc7792bff\") " pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"
Oct 30 20:45:48.872598 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:48.872522    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"
Oct 30 20:45:49.292928 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.292895    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"]
Oct 30 20:45:49.295115 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.295099    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:49.358422 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.358403    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-observability-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:45:49.358574 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.358429    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-observability-operator\"/\"kube-root-ca.crt\""
Oct 30 20:45:49.360318 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.360302    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-observability-operator\"/\"observability-operator-sa-dockercfg-qbt96\""
Oct 30 20:45:49.360413 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.360327    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-observability-operator\"/\"observability-operator-tls\""
Oct 30 20:45:49.382345 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:45:49.382324    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60b939e_3a4f_42ec_95f6_18efc7792bff.slice/crio-3db7288d6645b9e34941777f0789543bf210c450c3ab3db628cc0a4721cb49fa WatchSource:0}: Error finding container 3db7288d6645b9e34941777f0789543bf210c450c3ab3db628cc0a4721cb49fa: Status 404 returned error can't find the container with id 3db7288d6645b9e34941777f0789543bf210c450c3ab3db628cc0a4721cb49fa
Oct 30 20:45:49.385351 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.385337    5937 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:45:49.410188 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.410169    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9"]
Oct 30 20:45:49.411478 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.411462    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"]
Oct 30 20:45:49.431043 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.431021    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55tdm\" (UniqueName: \"kubernetes.io/projected/fcf1ce3f-688a-4cca-9123-8d2058958cb5-kube-api-access-55tdm\") pod \"observability-operator-599c6f89d-t4vvj\" (UID: \"fcf1ce3f-688a-4cca-9123-8d2058958cb5\") " pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:49.431132 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.431070    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/fcf1ce3f-688a-4cca-9123-8d2058958cb5-observability-operator-tls\") pod \"observability-operator-599c6f89d-t4vvj\" (UID: \"fcf1ce3f-688a-4cca-9123-8d2058958cb5\") " pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:49.532105 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.532065    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55tdm\" (UniqueName: \"kubernetes.io/projected/fcf1ce3f-688a-4cca-9123-8d2058958cb5-kube-api-access-55tdm\") pod \"observability-operator-599c6f89d-t4vvj\" (UID: \"fcf1ce3f-688a-4cca-9123-8d2058958cb5\") " pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:49.532105 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.532107    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/fcf1ce3f-688a-4cca-9123-8d2058958cb5-observability-operator-tls\") pod \"observability-operator-599c6f89d-t4vvj\" (UID: \"fcf1ce3f-688a-4cca-9123-8d2058958cb5\") " pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:49.534713 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.534686    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/fcf1ce3f-688a-4cca-9123-8d2058958cb5-observability-operator-tls\") pod \"observability-operator-599c6f89d-t4vvj\" (UID: \"fcf1ce3f-688a-4cca-9123-8d2058958cb5\") " pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:49.620482 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.620418    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55tdm\" (UniqueName: \"kubernetes.io/projected/fcf1ce3f-688a-4cca-9123-8d2058958cb5-kube-api-access-55tdm\") pod \"observability-operator-599c6f89d-t4vvj\" (UID: \"fcf1ce3f-688a-4cca-9123-8d2058958cb5\") " pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:49.906746 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:49.906668    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:50.129158 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:50.129126    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9" event={"ID":"b60b939e-3a4f-42ec-95f6-18efc7792bff","Type":"ContainerStarted","Data":"3db7288d6645b9e34941777f0789543bf210c450c3ab3db628cc0a4721cb49fa"}
Oct 30 20:45:50.365808 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:50.365736    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"]
Oct 30 20:45:50.369280 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:45:50.369248    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcf1ce3f_688a_4cca_9123_8d2058958cb5.slice/crio-4e5506ac3e91a52395f2fcd80574f4fdbebddb1cc1303a1a28e0664648ea1198 WatchSource:0}: Error finding container 4e5506ac3e91a52395f2fcd80574f4fdbebddb1cc1303a1a28e0664648ea1198: Status 404 returned error can't find the container with id 4e5506ac3e91a52395f2fcd80574f4fdbebddb1cc1303a1a28e0664648ea1198
Oct 30 20:45:51.134914 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:51.134879    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj" event={"ID":"fcf1ce3f-688a-4cca-9123-8d2058958cb5","Type":"ContainerStarted","Data":"4e5506ac3e91a52395f2fcd80574f4fdbebddb1cc1303a1a28e0664648ea1198"}
Oct 30 20:45:55.161740 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:55.161697    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9" event={"ID":"b60b939e-3a4f-42ec-95f6-18efc7792bff","Type":"ContainerStarted","Data":"28dd5a8f88e54207e312cc634147c98abaff8b8c1e2f1443207b00f1bfbc6aa5"}
Oct 30 20:45:56.162973 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:56.162895    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj" event={"ID":"fcf1ce3f-688a-4cca-9123-8d2058958cb5","Type":"ContainerStarted","Data":"243114249ab054348a7a55972d79758973d62bd29f0ef929bc2e977d6a3cc843"}
Oct 30 20:45:56.163349 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:56.163071    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:56.163924 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:56.163894    5937 patch_prober.go:29] interesting pod/observability-operator-599c6f89d-t4vvj container/operator namespace/openshift-cluster-observability-operator: Readiness probe status=failure output="Get \"http://10.134.0.18:8081/healthz\": dial tcp 10.134.0.18:8081: connect: connection refused" start-of-body=
Oct 30 20:45:56.163969 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:56.163949    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj" podUID="fcf1ce3f-688a-4cca-9123-8d2058958cb5" containerName="operator" probeResult="failure" output="Get \"http://10.134.0.18:8081/healthz\": dial tcp 10.134.0.18:8081: connect: connection refused"
Oct 30 20:45:56.296147 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:56.296073    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-observability-operator/obo-prometheus-operator-admission-webhook-564dd7b8b9-lk5f9" podStartSLOduration=2.728179087 podStartE2EDuration="8.296060452s" totalImagesPullingTime="5.567881365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:55.381529212 +0000 UTC m=+530.337543989" watchObservedRunningTime="2026-10-30 20:45:56.296060452 +0000 UTC m=+531.252075219"
Oct 30 20:45:57.167340 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:57.167315    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj"
Oct 30 20:45:57.392832 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:45:57.392787    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-observability-operator/observability-operator-599c6f89d-t4vvj" podStartSLOduration=2.982583013 podStartE2EDuration="8.39277167s" totalImagesPullingTime="5.410188657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:45:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:45:56.296377236 +0000 UTC m=+531.252392011" watchObservedRunningTime="2026-10-30 20:45:57.39277167 +0000 UTC m=+532.348786440"
Oct 30 20:46:15.671415 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:46:15.671289    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:46:28.400943 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.400911    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"]
Oct 30 20:46:28.403098 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.403082    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.440297 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.440270    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-webhook-cert\") pod \"opentelemetry-operator-webhook-696bb769c9-fg29h\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.440432 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.440311    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-apiservice-cert\") pod \"opentelemetry-operator-webhook-696bb769c9-fg29h\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.440432 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.440328    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnx54\" (UniqueName: \"kubernetes.io/projected/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-kube-api-access-nnx54\") pod \"opentelemetry-operator-webhook-696bb769c9-fg29h\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.462090 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.462068    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-opentelemetry-operator\"/\"openshift-service-ca.crt\""
Oct 30 20:46:28.462654 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.462642    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-opentelemetry-operator\"/\"opentelemetry-operator-webhook-service-cert\""
Oct 30 20:46:28.462883 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.462867    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-opentelemetry-operator\"/\"opentelemetry-operator-controller-manager-dockercfg-747cn\""
Oct 30 20:46:28.462936 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.462902    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-opentelemetry-operator\"/\"kube-root-ca.crt\""
Oct 30 20:46:28.514372 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.514349    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"]
Oct 30 20:46:28.541185 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.541159    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-webhook-cert\") pod \"opentelemetry-operator-webhook-696bb769c9-fg29h\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.541284 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.541193    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-apiservice-cert\") pod \"opentelemetry-operator-webhook-696bb769c9-fg29h\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.541284 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.541211    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnx54\" (UniqueName: \"kubernetes.io/projected/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-kube-api-access-nnx54\") pod \"opentelemetry-operator-webhook-696bb769c9-fg29h\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.543711 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.543688    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-apiservice-cert\") pod \"opentelemetry-operator-webhook-696bb769c9-fg29h\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.543789 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.543768    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-webhook-cert\") pod \"opentelemetry-operator-webhook-696bb769c9-fg29h\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.605204 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.605175    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnx54\" (UniqueName: \"kubernetes.io/projected/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-kube-api-access-nnx54\") pod \"opentelemetry-operator-webhook-696bb769c9-fg29h\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") " pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:28.712612 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:28.712593    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:29.135025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:29.135002    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"]
Oct 30 20:46:29.137709 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:46:29.137686    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd522a3c6_fb30_44b1_b257_c2e5f6ba61f5.slice/crio-0523cc02c73988d601321702c4ee6fe7825613a098e1c1cfddc516cf6ce87e7e WatchSource:0}: Error finding container 0523cc02c73988d601321702c4ee6fe7825613a098e1c1cfddc516cf6ce87e7e: Status 404 returned error can't find the container with id 0523cc02c73988d601321702c4ee6fe7825613a098e1c1cfddc516cf6ce87e7e
Oct 30 20:46:29.292153 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:29.292125    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h" event={"ID":"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5","Type":"ContainerStarted","Data":"0523cc02c73988d601321702c4ee6fe7825613a098e1c1cfddc516cf6ce87e7e"}
Oct 30 20:46:30.443967 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:30.443929    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"]
Oct 30 20:46:32.306951 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.306865    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h" event={"ID":"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5","Type":"ContainerStarted","Data":"038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e"}
Oct 30 20:46:32.307358 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.306972    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:32.307358 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.307004    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h" podUID="d522a3c6-fb30-44b1-b257-c2e5f6ba61f5" containerName="webhook" containerID="cri-o://038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e" gracePeriod=30
Oct 30 20:46:32.529916 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.529864    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h" podStartSLOduration=1.678372413 podStartE2EDuration="4.529849513s" totalImagesPullingTime="2.8514771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:32.478731573 +0000 UTC m=+567.434746419" watchObservedRunningTime="2026-10-30 20:46:32.529849513 +0000 UTC m=+567.485864269"
Oct 30 20:46:32.552849 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.552829    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:32.574039 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.573992    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-kube-api-access-nnx54\" (UniqueName: \"kubernetes.io/projected/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-kube-api-access-nnx54\") pod \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") "
Oct 30 20:46:32.574157 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.574036    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-webhook-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-webhook-cert\") pod \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") "
Oct 30 20:46:32.574275 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.574189    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-apiservice-cert\") pod \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\" (UID: \"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5\") "
Oct 30 20:46:32.576249 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.576221    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-webhook-cert" pod "d522a3c6-fb30-44b1-b257-c2e5f6ba61f5" (UID: "d522a3c6-fb30-44b1-b257-c2e5f6ba61f5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:46:32.576334 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.576290    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-kube-api-access-nnx54" pod "d522a3c6-fb30-44b1-b257-c2e5f6ba61f5" (UID: "d522a3c6-fb30-44b1-b257-c2e5f6ba61f5"). InnerVolumeSpecName "kube-api-access-nnx54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:46:32.576334 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.576291    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-apiservice-cert" pod "d522a3c6-fb30-44b1-b257-c2e5f6ba61f5" (UID: "d522a3c6-fb30-44b1-b257-c2e5f6ba61f5"). InnerVolumeSpecName "apiservice-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:46:32.675030 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.675002    5937 reconciler_common.go:299] "Volume detached for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-apiservice-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:32.675199 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.675035    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnx54\" (UniqueName: \"kubernetes.io/projected/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-kube-api-access-nnx54\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:32.675199 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:32.675053    5937 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5-webhook-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:46:33.313022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:33.312988    5937 generic.go:356] "Generic (PLEG): container finished" podID="d522a3c6-fb30-44b1-b257-c2e5f6ba61f5" containerID="038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e" exitCode=2
Oct 30 20:46:33.313423 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:33.313030    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"
Oct 30 20:46:33.313423 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:33.313041    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h" event={"ID":"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5","Type":"ContainerDied","Data":"038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e"}
Oct 30 20:46:33.313423 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:33.313090    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h" event={"ID":"d522a3c6-fb30-44b1-b257-c2e5f6ba61f5","Type":"ContainerDied","Data":"0523cc02c73988d601321702c4ee6fe7825613a098e1c1cfddc516cf6ce87e7e"}
Oct 30 20:46:33.313423 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:33.313110    5937 scope.go:122] "RemoveContainer" containerID="038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e"
Oct 30 20:46:33.321223 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:33.321198    5937 scope.go:122] "RemoveContainer" containerID="038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e"
Oct 30 20:46:33.321471 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:46:33.321451    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e\": container with ID starting with 038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e not found: ID does not exist" containerID="038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e"
Oct 30 20:46:33.321559 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:33.321483    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e"} err="failed to get container status \"038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e\": rpc error: code = NotFound desc = could not find container \"038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e\": container with ID starting with 038ab6cdeec0c3b5689363d56f407d213daa280f7d3c65273f91a7252122012e not found: ID does not exist"
Oct 30 20:46:33.530584 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:33.530552    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"]
Oct 30 20:46:33.581418 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:33.581390    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-opentelemetry-operator/opentelemetry-operator-webhook-696bb769c9-fg29h"]
Oct 30 20:46:35.160299 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:35.160258    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d522a3c6-fb30-44b1-b257-c2e5f6ba61f5" path="/var/lib/kubelet/pods/d522a3c6-fb30-44b1-b257-c2e5f6ba61f5/volumes"
Oct 30 20:46:43.405825 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.405797    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"]
Oct 30 20:46:43.406199 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.406122    5937 cpu_manager.go:414] "containerMap: removing container" podUID="d522a3c6-fb30-44b1-b257-c2e5f6ba61f5" containerName="webhook"
Oct 30 20:46:43.406199 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.406133    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d522a3c6-fb30-44b1-b257-c2e5f6ba61f5" containerName="webhook"
Oct 30 20:46:43.406199 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.406191    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="d522a3c6-fb30-44b1-b257-c2e5f6ba61f5" containerName="webhook"
Oct 30 20:46:43.408527 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.408512    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.461308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.461260    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"]
Oct 30 20:46:43.469393 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.469360    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"loki-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f762049d-cbb8-40d3-9179-e7c2c8099af9-loki-operator-metrics-cert\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.469516 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.469395    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24khc\" (UniqueName: \"kubernetes.io/projected/f762049d-cbb8-40d3-9179-e7c2c8099af9-kube-api-access-24khc\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.469614 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.469557    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f762049d-cbb8-40d3-9179-e7c2c8099af9-webhook-cert\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.469674 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.469655    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f762049d-cbb8-40d3-9179-e7c2c8099af9-manager-config\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.469718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.469707    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f762049d-cbb8-40d3-9179-e7c2c8099af9-apiservice-cert\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.511417 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.511394    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-controller-manager-service-cert\""
Oct 30 20:46:43.511417 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.511402    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-manager-config\""
Oct 30 20:46:43.511417 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.511403    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-controller-manager-dockercfg-mx5mn\""
Oct 30 20:46:43.511661 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.511515    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators-redhat\"/\"kube-root-ca.crt\""
Oct 30 20:46:43.511661 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.511590    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators-redhat\"/\"loki-operator-metrics\""
Oct 30 20:46:43.511661 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.511595    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators-redhat\"/\"openshift-service-ca.crt\""
Oct 30 20:46:43.570263 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.570235    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f762049d-cbb8-40d3-9179-e7c2c8099af9-webhook-cert\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.570373 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.570279    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f762049d-cbb8-40d3-9179-e7c2c8099af9-manager-config\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.570373 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.570307    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f762049d-cbb8-40d3-9179-e7c2c8099af9-apiservice-cert\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.570373 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.570334    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"loki-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f762049d-cbb8-40d3-9179-e7c2c8099af9-loki-operator-metrics-cert\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.570373 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.570358    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24khc\" (UniqueName: \"kubernetes.io/projected/f762049d-cbb8-40d3-9179-e7c2c8099af9-kube-api-access-24khc\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.571070 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.571047    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f762049d-cbb8-40d3-9179-e7c2c8099af9-manager-config\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.572859 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.572833    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"loki-operator-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f762049d-cbb8-40d3-9179-e7c2c8099af9-loki-operator-metrics-cert\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.572971 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.572923    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f762049d-cbb8-40d3-9179-e7c2c8099af9-apiservice-cert\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.573059 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.573042    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f762049d-cbb8-40d3-9179-e7c2c8099af9-webhook-cert\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.632823 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.632788    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24khc\" (UniqueName: \"kubernetes.io/projected/f762049d-cbb8-40d3-9179-e7c2c8099af9-kube-api-access-24khc\") pod \"loki-operator-controller-manager-7cfb775799-svz6z\" (UID: \"f762049d-cbb8-40d3-9179-e7c2c8099af9\") " pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:43.726414 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:43.726387    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:44.198264 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:44.198184    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"]
Oct 30 20:46:44.235969 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:46:44.235943    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf762049d_cbb8_40d3_9179_e7c2c8099af9.slice/crio-b51d8d0e2674b19717855256ff79fe1c9d866f6e66ba04950173ea11fc7130a2 WatchSource:0}: Error finding container b51d8d0e2674b19717855256ff79fe1c9d866f6e66ba04950173ea11fc7130a2: Status 404 returned error can't find the container with id b51d8d0e2674b19717855256ff79fe1c9d866f6e66ba04950173ea11fc7130a2
Oct 30 20:46:44.360390 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:44.360353    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z" event={"ID":"f762049d-cbb8-40d3-9179-e7c2c8099af9","Type":"ContainerStarted","Data":"b51d8d0e2674b19717855256ff79fe1c9d866f6e66ba04950173ea11fc7130a2"}
Oct 30 20:46:45.676999 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:46:45.676956    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:46:49.384174 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:49.384090    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z" event={"ID":"f762049d-cbb8-40d3-9179-e7c2c8099af9","Type":"ContainerStarted","Data":"67e5befbcf2f9ab70414e0e73e5a93c9a300f7ababcf5ab908498aba890a2173"}
Oct 30 20:46:49.384642 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:49.384325    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:46:49.615132 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:46:49.615080    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z" podStartSLOduration=1.7780267429999999 podStartE2EDuration="6.615067658s" totalImagesPullingTime="4.837040915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:46:49.5925669 +0000 UTC m=+584.548581675" watchObservedRunningTime="2026-10-30 20:46:49.615067658 +0000 UTC m=+584.571082424"
Oct 30 20:47:00.390299 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:00.390270    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators-redhat/loki-operator-controller-manager-7cfb775799-svz6z"
Oct 30 20:47:15.670289 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:47:15.670250    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:47:45.672125 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:47:45.672043    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:47:50.790820 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:50.790783    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:47:50.794088 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:50.794068    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:50.898379 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:50.898306    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 20:47:50.898379 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:50.898315    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:47:50.898379 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:50.898316    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 20:47:50.898379 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:50.898316    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:47:50.899189 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:50.899170    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:47:51.027016 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:51.026974    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/150d4fb6-2d80-4097-87f2-02c9f53edef4-plugins\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:51.027208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:51.027148    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6l6b\" (UniqueName: \"kubernetes.io/projected/150d4fb6-2d80-4097-87f2-02c9f53edef4-kube-api-access-m6l6b\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:51.027208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:51.027182    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/150d4fb6-2d80-4097-87f2-02c9f53edef4-config\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:51.128758 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:51.128658    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6l6b\" (UniqueName: \"kubernetes.io/projected/150d4fb6-2d80-4097-87f2-02c9f53edef4-kube-api-access-m6l6b\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:51.128758 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:51.128705    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/150d4fb6-2d80-4097-87f2-02c9f53edef4-config\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:51.128758 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:51.128747    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/150d4fb6-2d80-4097-87f2-02c9f53edef4-plugins\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:51.129168 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:51.129148    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/150d4fb6-2d80-4097-87f2-02c9f53edef4-plugins\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:51.129442 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:51.129421    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/150d4fb6-2d80-4097-87f2-02c9f53edef4-config\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:51.191489 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:51.191450    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6l6b\" (UniqueName: \"kubernetes.io/projected/150d4fb6-2d80-4097-87f2-02c9f53edef4-kube-api-access-m6l6b\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:53.355007 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:53.354966    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:53.462048 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:53.462010    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:53.557780 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:53.557738    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:53.558057 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:53.558037    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:53.611527 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:53.611451    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:53.822072 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:53.822043    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:53.886498 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:53.886427    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:54.105634 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:54.105577    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:47:54.479421 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:54.479397    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:47:54.481296 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:47:54.481270    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod150d4fb6_2d80_4097_87f2_02c9f53edef4.slice/crio-52b79157f0a530fd04d63308195b11ca8c7a7495b513a52fc0fc26683f08a1e2 WatchSource:0}: Error finding container 52b79157f0a530fd04d63308195b11ca8c7a7495b513a52fc0fc26683f08a1e2: Status 404 returned error can't find the container with id 52b79157f0a530fd04d63308195b11ca8c7a7495b513a52fc0fc26683f08a1e2
Oct 30 20:47:54.647391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:47:54.647356    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"150d4fb6-2d80-4097-87f2-02c9f53edef4","Type":"ContainerStarted","Data":"52b79157f0a530fd04d63308195b11ca8c7a7495b513a52fc0fc26683f08a1e2"}
Oct 30 20:48:00.678258 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:00.678221    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"150d4fb6-2d80-4097-87f2-02c9f53edef4","Type":"ContainerStarted","Data":"e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230"}
Oct 30 20:48:00.678655 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:00.678292    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:48:00.797331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:00.797266    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=8.423133503 podStartE2EDuration="13.797248783s" totalImagesPullingTime="5.37411528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:00.797047994 +0000 UTC m=+655.753062790" watchObservedRunningTime="2026-10-30 20:48:00.797248783 +0000 UTC m=+655.753263560"
Oct 30 20:48:11.685140 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:11.685104    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:48:14.386158 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.386124    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:48:14.386731 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.386306    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="150d4fb6-2d80-4097-87f2-02c9f53edef4" containerName="perses" containerID="cri-o://e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230" gracePeriod=30
Oct 30 20:48:14.628477 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.628450    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:48:14.736501 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.736471    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/150d4fb6-2d80-4097-87f2-02c9f53edef4-plugins\" (UniqueName: \"kubernetes.io/empty-dir/150d4fb6-2d80-4097-87f2-02c9f53edef4-plugins\") pod \"150d4fb6-2d80-4097-87f2-02c9f53edef4\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") "
Oct 30 20:48:14.736778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.736529    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/150d4fb6-2d80-4097-87f2-02c9f53edef4-config\" (UniqueName: \"kubernetes.io/configmap/150d4fb6-2d80-4097-87f2-02c9f53edef4-config\") pod \"150d4fb6-2d80-4097-87f2-02c9f53edef4\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") "
Oct 30 20:48:14.736778 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.736696    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/150d4fb6-2d80-4097-87f2-02c9f53edef4-kube-api-access-m6l6b\" (UniqueName: \"kubernetes.io/projected/150d4fb6-2d80-4097-87f2-02c9f53edef4-kube-api-access-m6l6b\") pod \"150d4fb6-2d80-4097-87f2-02c9f53edef4\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") "
Oct 30 20:48:14.736924 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.736799    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"150d4fb6-2d80-4097-87f2-02c9f53edef4\" (UID: \"150d4fb6-2d80-4097-87f2-02c9f53edef4\") "
Oct 30 20:48:14.736983 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.736918    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/150d4fb6-2d80-4097-87f2-02c9f53edef4-config" pod "150d4fb6-2d80-4097-87f2-02c9f53edef4" (UID: "150d4fb6-2d80-4097-87f2-02c9f53edef4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:48:14.737147 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.737129    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/150d4fb6-2d80-4097-87f2-02c9f53edef4-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:14.739222 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.739198    5937 generic.go:356] "Generic (PLEG): container finished" podID="150d4fb6-2d80-4097-87f2-02c9f53edef4" containerID="e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230" exitCode=0
Oct 30 20:48:14.739354 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.739263    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"150d4fb6-2d80-4097-87f2-02c9f53edef4","Type":"ContainerDied","Data":"e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230"}
Oct 30 20:48:14.739354 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.739305    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"150d4fb6-2d80-4097-87f2-02c9f53edef4","Type":"ContainerDied","Data":"52b79157f0a530fd04d63308195b11ca8c7a7495b513a52fc0fc26683f08a1e2"}
Oct 30 20:48:14.739354 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.739322    5937 scope.go:122] "RemoveContainer" containerID="e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230"
Oct 30 20:48:14.739354 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.739265    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:48:14.742324 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.742299    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "150d4fb6-2d80-4097-87f2-02c9f53edef4" (UID: "150d4fb6-2d80-4097-87f2-02c9f53edef4"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 20:48:14.756769 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.756726    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150d4fb6-2d80-4097-87f2-02c9f53edef4-kube-api-access-m6l6b" pod "150d4fb6-2d80-4097-87f2-02c9f53edef4" (UID: "150d4fb6-2d80-4097-87f2-02c9f53edef4"). InnerVolumeSpecName "kube-api-access-m6l6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:48:14.757303 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.757274    5937 scope.go:122] "RemoveContainer" containerID="e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230"
Oct 30 20:48:14.757733 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:14.757707    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230\": container with ID starting with e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230 not found: ID does not exist" containerID="e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230"
Oct 30 20:48:14.757829 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.757743    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230"} err="failed to get container status \"e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230\": rpc error: code = NotFound desc = could not find container \"e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230\": container with ID starting with e4f33fa0d04c529795c30692511614e998efb1ecbc43edea6ab2313071e02230 not found: ID does not exist"
Oct 30 20:48:14.837600 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.837562    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6l6b\" (UniqueName: \"kubernetes.io/projected/150d4fb6-2d80-4097-87f2-02c9f53edef4-kube-api-access-m6l6b\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:14.837769 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.837614    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 20:48:14.849790 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.849767    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:48:14.895379 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.895338    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/150d4fb6-2d80-4097-87f2-02c9f53edef4-plugins" pod "150d4fb6-2d80-4097-87f2-02c9f53edef4" (UID: "150d4fb6-2d80-4097-87f2-02c9f53edef4"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:48:14.938255 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.938215    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 20:48:14.938255 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:14.938248    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/150d4fb6-2d80-4097-87f2-02c9f53edef4-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:15.161725 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:15.161693    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:48:15.163375 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:15.163351    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:48:15.672302 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:15.672214    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:48:17.160504 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:17.160474    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="150d4fb6-2d80-4097-87f2-02c9f53edef4" path="/var/lib/kubelet/pods/150d4fb6-2d80-4097-87f2-02c9f53edef4/volumes"
Oct 30 20:48:27.413047 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.413014    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"]
Oct 30 20:48:27.413551 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.413522    5937 cpu_manager.go:414] "containerMap: removing container" podUID="150d4fb6-2d80-4097-87f2-02c9f53edef4" containerName="perses"
Oct 30 20:48:27.413616 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.413560    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="150d4fb6-2d80-4097-87f2-02c9f53edef4" containerName="perses"
Oct 30 20:48:27.413688 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.413675    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="150d4fb6-2d80-4097-87f2-02c9f53edef4" containerName="perses"
Oct 30 20:48:27.416701 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.416684    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:27.450355 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.450322    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4pzh\" (UniqueName: \"kubernetes.io/projected/b1e36dc2-5e56-4601-9005-69e8e055c04b-kube-api-access-d4pzh\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:27.450476 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.450360    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:27.450476 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.450388    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b1e36dc2-5e56-4601-9005-69e8e055c04b-ta-internal\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:27.534987 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.534957    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-xck9g\""
Oct 30 20:48:27.534987 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.534952    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 20:48:27.535184 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.535034    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:48:27.535184 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.535059    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:48:27.535184 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.535107    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 20:48:27.535874 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.535856    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"]
Oct 30 20:48:27.551616 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.551594    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4pzh\" (UniqueName: \"kubernetes.io/projected/b1e36dc2-5e56-4601-9005-69e8e055c04b-kube-api-access-d4pzh\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:27.551717 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.551621    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:27.551717 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.551651    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b1e36dc2-5e56-4601-9005-69e8e055c04b-ta-internal\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:27.551832 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:27.551775    5937 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-server-cert: secret "data-science-collector-ta-server-cert" not found
Oct 30 20:48:27.551886 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:27.551873    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert podName:b1e36dc2-5e56-4601-9005-69e8e055c04b nodeName:}" failed. No retries permitted until 2026-10-30 20:48:28.051849311 +0000 UTC m=+683.007864100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-server-cert" (UniqueName: "kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert") pod "data-science-collector-targetallocator-56777f66bc-cr4bb" (UID: "b1e36dc2-5e56-4601-9005-69e8e055c04b") : secret "data-science-collector-ta-server-cert" not found
Oct 30 20:48:27.552244 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.552224    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b1e36dc2-5e56-4601-9005-69e8e055c04b-ta-internal\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:27.621055 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:27.621035    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4pzh\" (UniqueName: \"kubernetes.io/projected/b1e36dc2-5e56-4601-9005-69e8e055c04b-kube-api-access-d4pzh\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:28.054956 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:28.054923    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:28.055126 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:28.055022    5937 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-server-cert: secret "data-science-collector-ta-server-cert" not found
Oct 30 20:48:28.055126 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:28.055086    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert podName:b1e36dc2-5e56-4601-9005-69e8e055c04b nodeName:}" failed. No retries permitted until 2026-10-30 20:48:29.0550722 +0000 UTC m=+684.011086967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-server-cert" (UniqueName: "kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert") pod "data-science-collector-targetallocator-56777f66bc-cr4bb" (UID: "b1e36dc2-5e56-4601-9005-69e8e055c04b") : secret "data-science-collector-ta-server-cert" not found
Oct 30 20:48:29.064590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:29.064533    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:29.064960 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:29.064684    5937 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-ta-server-cert: secret "data-science-collector-ta-server-cert" not found
Oct 30 20:48:29.064960 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:29.064763    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert podName:b1e36dc2-5e56-4601-9005-69e8e055c04b nodeName:}" failed. No retries permitted until 2026-10-30 20:48:31.064744921 +0000 UTC m=+686.020759692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "data-science-collector-ta-server-cert" (UniqueName: "kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert") pod "data-science-collector-targetallocator-56777f66bc-cr4bb" (UID: "b1e36dc2-5e56-4601-9005-69e8e055c04b") : secret "data-science-collector-ta-server-cert" not found
Oct 30 20:48:31.083533 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:31.083491    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:31.086037 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:31.086016    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-56777f66bc-cr4bb\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:31.328219 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:31.328173    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:31.699962 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:31.699912    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"]
Oct 30 20:48:31.702768 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:48:31.702743    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1e36dc2_5e56_4601_9005_69e8e055c04b.slice/crio-baf35e7593096b15787b7f03840db14331716f3a5973b08753b35a61aa103bdc WatchSource:0}: Error finding container baf35e7593096b15787b7f03840db14331716f3a5973b08753b35a61aa103bdc: Status 404 returned error can't find the container with id baf35e7593096b15787b7f03840db14331716f3a5973b08753b35a61aa103bdc
Oct 30 20:48:31.815400 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:31.815367    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb" event={"ID":"b1e36dc2-5e56-4601-9005-69e8e055c04b","Type":"ContainerStarted","Data":"baf35e7593096b15787b7f03840db14331716f3a5973b08753b35a61aa103bdc"}
Oct 30 20:48:35.359488 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:35.359457    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:35.359806 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:35.359526    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:48:35.834892 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:35.834852    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb" event={"ID":"b1e36dc2-5e56-4601-9005-69e8e055c04b","Type":"ContainerStarted","Data":"40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64"}
Oct 30 20:48:35.835085 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:35.835017    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:35.836067 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:35.836046    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb" podUID="b1e36dc2-5e56-4601-9005-69e8e055c04b" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.22:8080/readyz\": dial tcp 10.134.0.22:8080: connect: connection refused"
Oct 30 20:48:35.955589 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:35.955501    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb" podStartSLOduration=5.301736861 podStartE2EDuration="8.955488319s" totalImagesPullingTime="3.653751458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:48:35.953854329 +0000 UTC m=+690.909869106" watchObservedRunningTime="2026-10-30 20:48:35.955488319 +0000 UTC m=+690.911503075"
Oct 30 20:48:36.840197 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:36.840172    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:45.671210 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:45.671171    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:48:50.885583 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:50.885554    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"]
Oct 30 20:48:50.886023 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:50.885753    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb" podUID="b1e36dc2-5e56-4601-9005-69e8e055c04b" containerName="ta-container" containerID="cri-o://40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64" gracePeriod=30
Oct 30 20:48:51.130375 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.130352    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:51.256728 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.256694    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1e36dc2-5e56-4601-9005-69e8e055c04b-ta-internal\" (UniqueName: \"kubernetes.io/configmap/b1e36dc2-5e56-4601-9005-69e8e055c04b-ta-internal\") pod \"b1e36dc2-5e56-4601-9005-69e8e055c04b\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") "
Oct 30 20:48:51.256904 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.256797    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1e36dc2-5e56-4601-9005-69e8e055c04b-kube-api-access-d4pzh\" (UniqueName: \"kubernetes.io/projected/b1e36dc2-5e56-4601-9005-69e8e055c04b-kube-api-access-d4pzh\") pod \"b1e36dc2-5e56-4601-9005-69e8e055c04b\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") "
Oct 30 20:48:51.256955 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.256927    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert\") pod \"b1e36dc2-5e56-4601-9005-69e8e055c04b\" (UID: \"b1e36dc2-5e56-4601-9005-69e8e055c04b\") "
Oct 30 20:48:51.257076 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.257045    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e36dc2-5e56-4601-9005-69e8e055c04b-ta-internal" pod "b1e36dc2-5e56-4601-9005-69e8e055c04b" (UID: "b1e36dc2-5e56-4601-9005-69e8e055c04b"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:48:51.257499 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.257226    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/b1e36dc2-5e56-4601-9005-69e8e055c04b-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:51.259316 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.259283    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1e36dc2-5e56-4601-9005-69e8e055c04b-kube-api-access-d4pzh" pod "b1e36dc2-5e56-4601-9005-69e8e055c04b" (UID: "b1e36dc2-5e56-4601-9005-69e8e055c04b"). InnerVolumeSpecName "kube-api-access-d4pzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:48:51.259587 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.259522    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert" pod "b1e36dc2-5e56-4601-9005-69e8e055c04b" (UID: "b1e36dc2-5e56-4601-9005-69e8e055c04b"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:48:51.358450 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.358417    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/b1e36dc2-5e56-4601-9005-69e8e055c04b-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:51.358450 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.358444    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4pzh\" (UniqueName: \"kubernetes.io/projected/b1e36dc2-5e56-4601-9005-69e8e055c04b-kube-api-access-d4pzh\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:48:51.903813 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.903783    5937 generic.go:356] "Generic (PLEG): container finished" podID="b1e36dc2-5e56-4601-9005-69e8e055c04b" containerID="40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64" exitCode=0
Oct 30 20:48:51.904248 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.903827    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"
Oct 30 20:48:51.904248 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.903866    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb" event={"ID":"b1e36dc2-5e56-4601-9005-69e8e055c04b","Type":"ContainerDied","Data":"40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64"}
Oct 30 20:48:51.904248 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.903909    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb" event={"ID":"b1e36dc2-5e56-4601-9005-69e8e055c04b","Type":"ContainerDied","Data":"baf35e7593096b15787b7f03840db14331716f3a5973b08753b35a61aa103bdc"}
Oct 30 20:48:51.904248 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.903927    5937 scope.go:122] "RemoveContainer" containerID="40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64"
Oct 30 20:48:51.912353 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.912331    5937 scope.go:122] "RemoveContainer" containerID="40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64"
Oct 30 20:48:51.912691 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:48:51.912673    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64\": container with ID starting with 40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64 not found: ID does not exist" containerID="40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64"
Oct 30 20:48:51.912770 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:51.912699    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64"} err="failed to get container status \"40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64\": rpc error: code = NotFound desc = could not find container \"40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64\": container with ID starting with 40a92e9f40cb779139e3a2252e519afa28b96212e4852c2aab21ccb7f7d27e64 not found: ID does not exist"
Oct 30 20:48:52.071819 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:52.071786    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"]
Oct 30 20:48:52.122573 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:52.122521    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-56777f66bc-cr4bb"]
Oct 30 20:48:53.160983 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:48:53.160948    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1e36dc2-5e56-4601-9005-69e8e055c04b" path="/var/lib/kubelet/pods/b1e36dc2-5e56-4601-9005-69e8e055c04b/volumes"
Oct 30 20:49:15.670971 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:49:15.670878    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:49:32.103720 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.103684    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"]
Oct 30 20:49:32.104796 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.104761    5937 cpu_manager.go:414] "containerMap: removing container" podUID="b1e36dc2-5e56-4601-9005-69e8e055c04b" containerName="ta-container"
Oct 30 20:49:32.104796 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.104793    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1e36dc2-5e56-4601-9005-69e8e055c04b" containerName="ta-container"
Oct 30 20:49:32.105071 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.105058    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1e36dc2-5e56-4601-9005-69e8e055c04b" containerName="ta-container"
Oct 30 20:49:32.111289 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.111259    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.165015 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.164983    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"]
Oct 30 20:49:32.179956 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.179931    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgqfs\" (UniqueName: \"kubernetes.io/projected/3b75381b-52c6-47d4-9c47-19000e0441a9-kube-api-access-kgqfs\") pod \"data-science-collector-targetallocator-85f675c95f-ksfnx\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.180087 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.179979    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3b75381b-52c6-47d4-9c47-19000e0441a9-ta-internal\") pod \"data-science-collector-targetallocator-85f675c95f-ksfnx\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.180087 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.180073    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3b75381b-52c6-47d4-9c47-19000e0441a9-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-85f675c95f-ksfnx\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.218021 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.217995    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:49:32.218326 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.218311    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-xdkl6\""
Oct 30 20:49:32.218562 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.218525    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 20:49:32.219481 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.219461    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 20:49:32.219754 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.219740    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:49:32.280532 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.280500    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3b75381b-52c6-47d4-9c47-19000e0441a9-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-85f675c95f-ksfnx\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.280700 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.280604    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgqfs\" (UniqueName: \"kubernetes.io/projected/3b75381b-52c6-47d4-9c47-19000e0441a9-kube-api-access-kgqfs\") pod \"data-science-collector-targetallocator-85f675c95f-ksfnx\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.280700 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.280660    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3b75381b-52c6-47d4-9c47-19000e0441a9-ta-internal\") pod \"data-science-collector-targetallocator-85f675c95f-ksfnx\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.281395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.281373    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3b75381b-52c6-47d4-9c47-19000e0441a9-ta-internal\") pod \"data-science-collector-targetallocator-85f675c95f-ksfnx\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.283178 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.283152    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3b75381b-52c6-47d4-9c47-19000e0441a9-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-85f675c95f-ksfnx\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.342979 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.342949    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgqfs\" (UniqueName: \"kubernetes.io/projected/3b75381b-52c6-47d4-9c47-19000e0441a9-kube-api-access-kgqfs\") pod \"data-science-collector-targetallocator-85f675c95f-ksfnx\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.420982 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.420921    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:32.791139 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.791119    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"]
Oct 30 20:49:32.793273 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:49:32.793240    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b75381b_52c6_47d4_9c47_19000e0441a9.slice/crio-ad63b2482ecaec05481e6b3d3aa078edab6505edb90fce56caa2a7d8a998df13 WatchSource:0}: Error finding container ad63b2482ecaec05481e6b3d3aa078edab6505edb90fce56caa2a7d8a998df13: Status 404 returned error can't find the container with id ad63b2482ecaec05481e6b3d3aa078edab6505edb90fce56caa2a7d8a998df13
Oct 30 20:49:32.795364 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.795321    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:49:32.795445 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:32.795401    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:49:33.073698 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:33.073620    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx" event={"ID":"3b75381b-52c6-47d4-9c47-19000e0441a9","Type":"ContainerStarted","Data":"72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce"}
Oct 30 20:49:33.073698 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:33.073662    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx" event={"ID":"3b75381b-52c6-47d4-9c47-19000e0441a9","Type":"ContainerStarted","Data":"ad63b2482ecaec05481e6b3d3aa078edab6505edb90fce56caa2a7d8a998df13"}
Oct 30 20:49:33.073891 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:33.073851    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:33.074728 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:33.074699    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx" podUID="3b75381b-52c6-47d4-9c47-19000e0441a9" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.23:8080/readyz\": dial tcp 10.134.0.23:8080: connect: connection refused"
Oct 30 20:49:33.192337 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:33.192292    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx" podStartSLOduration=1.192278651 podStartE2EDuration="1.192278651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:49:33.191671932 +0000 UTC m=+748.147686709" watchObservedRunningTime="2026-10-30 20:49:33.192278651 +0000 UTC m=+748.148293417"
Oct 30 20:49:34.079916 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:34.079890    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:45.671612 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:49:45.671575    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:49:58.761254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:58.761223    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"]
Oct 30 20:49:58.761743 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:58.761402    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx" podUID="3b75381b-52c6-47d4-9c47-19000e0441a9" containerName="ta-container" containerID="cri-o://72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce" gracePeriod=30
Oct 30 20:49:59.008709 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.008688    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:59.106696 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.106626    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b75381b-52c6-47d4-9c47-19000e0441a9-ta-internal\" (UniqueName: \"kubernetes.io/configmap/3b75381b-52c6-47d4-9c47-19000e0441a9-ta-internal\") pod \"3b75381b-52c6-47d4-9c47-19000e0441a9\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") "
Oct 30 20:49:59.106696 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.106670    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b75381b-52c6-47d4-9c47-19000e0441a9-kube-api-access-kgqfs\" (UniqueName: \"kubernetes.io/projected/3b75381b-52c6-47d4-9c47-19000e0441a9-kube-api-access-kgqfs\") pod \"3b75381b-52c6-47d4-9c47-19000e0441a9\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") "
Oct 30 20:49:59.106899 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.106738    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b75381b-52c6-47d4-9c47-19000e0441a9-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3b75381b-52c6-47d4-9c47-19000e0441a9-data-science-collector-ta-server-cert\") pod \"3b75381b-52c6-47d4-9c47-19000e0441a9\" (UID: \"3b75381b-52c6-47d4-9c47-19000e0441a9\") "
Oct 30 20:49:59.107067 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.107041    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b75381b-52c6-47d4-9c47-19000e0441a9-ta-internal" pod "3b75381b-52c6-47d4-9c47-19000e0441a9" (UID: "3b75381b-52c6-47d4-9c47-19000e0441a9"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:49:59.108859 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.108836    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b75381b-52c6-47d4-9c47-19000e0441a9-data-science-collector-ta-server-cert" pod "3b75381b-52c6-47d4-9c47-19000e0441a9" (UID: "3b75381b-52c6-47d4-9c47-19000e0441a9"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:49:59.108984 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.108963    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b75381b-52c6-47d4-9c47-19000e0441a9-kube-api-access-kgqfs" pod "3b75381b-52c6-47d4-9c47-19000e0441a9" (UID: "3b75381b-52c6-47d4-9c47-19000e0441a9"). InnerVolumeSpecName "kube-api-access-kgqfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:49:59.185122 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.185091    5937 generic.go:356] "Generic (PLEG): container finished" podID="3b75381b-52c6-47d4-9c47-19000e0441a9" containerID="72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce" exitCode=0
Oct 30 20:49:59.185252 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.185137    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"
Oct 30 20:49:59.185252 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.185143    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx" event={"ID":"3b75381b-52c6-47d4-9c47-19000e0441a9","Type":"ContainerDied","Data":"72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce"}
Oct 30 20:49:59.185252 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.185173    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx" event={"ID":"3b75381b-52c6-47d4-9c47-19000e0441a9","Type":"ContainerDied","Data":"ad63b2482ecaec05481e6b3d3aa078edab6505edb90fce56caa2a7d8a998df13"}
Oct 30 20:49:59.185252 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.185188    5937 scope.go:122] "RemoveContainer" containerID="72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce"
Oct 30 20:49:59.193275 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.193261    5937 scope.go:122] "RemoveContainer" containerID="72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce"
Oct 30 20:49:59.193505 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:49:59.193485    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce\": container with ID starting with 72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce not found: ID does not exist" containerID="72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce"
Oct 30 20:49:59.193566 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.193513    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce"} err="failed to get container status \"72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce\": rpc error: code = NotFound desc = could not find container \"72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce\": container with ID starting with 72fa18bdfbb56400d6e645c2b6b67b235080557e582a0755f8514dcc4cfc51ce not found: ID does not exist"
Oct 30 20:49:59.207936 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.207919    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/3b75381b-52c6-47d4-9c47-19000e0441a9-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:59.207993 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.207939    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgqfs\" (UniqueName: \"kubernetes.io/projected/3b75381b-52c6-47d4-9c47-19000e0441a9-kube-api-access-kgqfs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:59.207993 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.207949    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/3b75381b-52c6-47d4-9c47-19000e0441a9-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:49:59.351688 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.351662    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"]
Oct 30 20:49:59.355393 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:49:59.355373    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-85f675c95f-ksfnx"]
Oct 30 20:50:01.161052 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:01.161018    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b75381b-52c6-47d4-9c47-19000e0441a9" path="/var/lib/kubelet/pods/3b75381b-52c6-47d4-9c47-19000e0441a9/volumes"
Oct 30 20:50:15.270444 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.270416    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"]
Oct 30 20:50:15.270822 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.270783    5937 cpu_manager.go:414] "containerMap: removing container" podUID="3b75381b-52c6-47d4-9c47-19000e0441a9" containerName="ta-container"
Oct 30 20:50:15.270822 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.270794    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b75381b-52c6-47d4-9c47-19000e0441a9" containerName="ta-container"
Oct 30 20:50:15.270901 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.270863    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b75381b-52c6-47d4-9c47-19000e0441a9" containerName="ta-container"
Oct 30 20:50:15.274886 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.274863    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"
Oct 30 20:50:15.331075 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.331045    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"]
Oct 30 20:50:15.331216 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.331110    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:50:15.331293 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.331275    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 20:50:15.331355 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.331316    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:50:15.332694 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.332670    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf8n7\" (UniqueName: \"kubernetes.io/projected/8e1fb953-b578-4c5f-85d0-47aa86273309-kube-api-access-vf8n7\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5\" (UID: \"8e1fb953-b578-4c5f-85d0-47aa86273309\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"
Oct 30 20:50:15.433712 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.433683    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf8n7\" (UniqueName: \"kubernetes.io/projected/8e1fb953-b578-4c5f-85d0-47aa86273309-kube-api-access-vf8n7\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5\" (UID: \"8e1fb953-b578-4c5f-85d0-47aa86273309\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"
Oct 30 20:50:15.497308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.497285    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf8n7\" (UniqueName: \"kubernetes.io/projected/8e1fb953-b578-4c5f-85d0-47aa86273309-kube-api-access-vf8n7\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5\" (UID: \"8e1fb953-b578-4c5f-85d0-47aa86273309\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"
Oct 30 20:50:15.586257 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.586200    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"
Oct 30 20:50:15.673419 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:50:15.673382    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:50:15.958755 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:15.958726    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"]
Oct 30 20:50:15.964615 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:50:15.964511    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e1fb953_b578_4c5f_85d0_47aa86273309.slice/crio-d35a58c2d2e5416250caf8743a0ee78790f0f6c648f12d0322fd1ef90b042318 WatchSource:0}: Error finding container d35a58c2d2e5416250caf8743a0ee78790f0f6c648f12d0322fd1ef90b042318: Status 404 returned error can't find the container with id d35a58c2d2e5416250caf8743a0ee78790f0f6c648f12d0322fd1ef90b042318
Oct 30 20:50:16.256394 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:16.256312    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5" event={"ID":"8e1fb953-b578-4c5f-85d0-47aa86273309","Type":"ContainerStarted","Data":"d35a58c2d2e5416250caf8743a0ee78790f0f6c648f12d0322fd1ef90b042318"}
Oct 30 20:50:18.564911 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.564876    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:50:18.568750 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.568727    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.625797 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.625767    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:50:18.674786 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.674752    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 20:50:18.758225 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.758195    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"]
Oct 30 20:50:18.761523 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.761504    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:18.764061 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.764036    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/1f9dde64-7266-419e-afd0-39eb30a5139a-plugins\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.764170 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.764106    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nh22\" (UniqueName: \"kubernetes.io/projected/1f9dde64-7266-419e-afd0-39eb30a5139a-kube-api-access-8nh22\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.764247 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.764190    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f9dde64-7266-419e-afd0-39eb30a5139a-config\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.815658 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.815595    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 20:50:18.815658 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.815595    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-f4dmm\""
Oct 30 20:50:18.819595 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.819564    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 20:50:18.821364 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.821340    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"]
Oct 30 20:50:18.864939 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.864904    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nh22\" (UniqueName: \"kubernetes.io/projected/1f9dde64-7266-419e-afd0-39eb30a5139a-kube-api-access-8nh22\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.865075 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.864952    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f9dde64-7266-419e-afd0-39eb30a5139a-config\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.865075 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.864987    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-ta-internal\") pod \"data-science-collector-targetallocator-585d475bc4-8p6hs\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:18.865075 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.865033    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mphj8\" (UniqueName: \"kubernetes.io/projected/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-kube-api-access-mphj8\") pod \"data-science-collector-targetallocator-585d475bc4-8p6hs\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:18.865075 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.865071    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-585d475bc4-8p6hs\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:18.865289 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.865100    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/1f9dde64-7266-419e-afd0-39eb30a5139a-plugins\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.865565 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.865516    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/1f9dde64-7266-419e-afd0-39eb30a5139a-plugins\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.865990 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.865962    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f9dde64-7266-419e-afd0-39eb30a5139a-config\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.928410 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.928377    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nh22\" (UniqueName: \"kubernetes.io/projected/1f9dde64-7266-419e-afd0-39eb30a5139a-kube-api-access-8nh22\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:18.966513 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.966477    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-585d475bc4-8p6hs\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:18.966663 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.966591    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-ta-internal\") pod \"data-science-collector-targetallocator-585d475bc4-8p6hs\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:18.966663 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.966635    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mphj8\" (UniqueName: \"kubernetes.io/projected/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-kube-api-access-mphj8\") pod \"data-science-collector-targetallocator-585d475bc4-8p6hs\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:18.967436 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.967408    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-ta-internal\") pod \"data-science-collector-targetallocator-585d475bc4-8p6hs\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:18.969323 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:18.969295    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-585d475bc4-8p6hs\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:19.029715 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:19.029680    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mphj8\" (UniqueName: \"kubernetes.io/projected/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-kube-api-access-mphj8\") pod \"data-science-collector-targetallocator-585d475bc4-8p6hs\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:19.075768 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:19.075700    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:19.455375 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:19.455351    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"]
Oct 30 20:50:19.457524 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:50:19.457488    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod129aff5b_f0a1_426c_9db6_b3ea65dd7e86.slice/crio-4d74ce08c2ba17eec64afab885c5359d852755249afd0e1dcad6c19cb53d73be WatchSource:0}: Error finding container 4d74ce08c2ba17eec64afab885c5359d852755249afd0e1dcad6c19cb53d73be: Status 404 returned error can't find the container with id 4d74ce08c2ba17eec64afab885c5359d852755249afd0e1dcad6c19cb53d73be
Oct 30 20:50:19.459906 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:19.459876    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:50:19.459990 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:19.459931    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:50:20.282076 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:20.282044    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5" event={"ID":"8e1fb953-b578-4c5f-85d0-47aa86273309","Type":"ContainerStarted","Data":"a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77"}
Oct 30 20:50:20.283526 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:20.283492    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs" event={"ID":"129aff5b-f0a1-426c-9db6-b3ea65dd7e86","Type":"ContainerStarted","Data":"d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7"}
Oct 30 20:50:20.283663 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:20.283530    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs" event={"ID":"129aff5b-f0a1-426c-9db6-b3ea65dd7e86","Type":"ContainerStarted","Data":"4d74ce08c2ba17eec64afab885c5359d852755249afd0e1dcad6c19cb53d73be"}
Oct 30 20:50:20.283728 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:20.283671    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:20.284989 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:20.284960    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs" podUID="129aff5b-f0a1-426c-9db6-b3ea65dd7e86" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.26:8080/readyz\": dial tcp 10.134.0.26:8080: connect: connection refused"
Oct 30 20:50:20.399817 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:20.399760    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5" podStartSLOduration=1.150471427 podStartE2EDuration="5.399742372s" totalImagesPullingTime="4.249270945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:20.399220377 +0000 UTC m=+795.355235155" watchObservedRunningTime="2026-10-30 20:50:20.399742372 +0000 UTC m=+795.355757149"
Oct 30 20:50:20.518925 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:20.518874    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs" podStartSLOduration=2.518860583 podStartE2EDuration="2.518860583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:20.517635815 +0000 UTC m=+795.473650593" watchObservedRunningTime="2026-10-30 20:50:20.518860583 +0000 UTC m=+795.474875359"
Oct 30 20:50:21.288651 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:21.288624    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:50:25.520075 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:25.520045    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:25.626727 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:25.626691    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:25.721006 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:25.720973    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:25.721138 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:25.721117    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:25.774379 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:25.774323    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:25.915502 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:25.915463    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:25.980858 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:25.980829    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:26.080753 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:26.080686    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:26.453352 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:26.453329    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:50:26.457051 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:50:26.457023    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f9dde64_7266_419e_afd0_39eb30a5139a.slice/crio-1b47774270b8e84300dc50761644e6dac14ce4c3583c019809eb04c815131b3f WatchSource:0}: Error finding container 1b47774270b8e84300dc50761644e6dac14ce4c3583c019809eb04c815131b3f: Status 404 returned error can't find the container with id 1b47774270b8e84300dc50761644e6dac14ce4c3583c019809eb04c815131b3f
Oct 30 20:50:27.312941 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:27.312866    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"1f9dde64-7266-419e-afd0-39eb30a5139a","Type":"ContainerStarted","Data":"94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a"}
Oct 30 20:50:27.312941 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:27.312908    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"1f9dde64-7266-419e-afd0-39eb30a5139a","Type":"ContainerStarted","Data":"1b47774270b8e84300dc50761644e6dac14ce4c3583c019809eb04c815131b3f"}
Oct 30 20:50:27.312941 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:27.312936    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:35.683856 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.683798    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=17.683783355 podStartE2EDuration="17.683783355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:50:27.432829286 +0000 UTC m=+802.388844061" watchObservedRunningTime="2026-10-30 20:50:35.683783355 +0000 UTC m=+810.639798121"
Oct 30 20:50:35.684364 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.684233    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"]
Oct 30 20:50:35.684410 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.684396    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5" podUID="8e1fb953-b578-4c5f-85d0-47aa86273309" containerName="thanos-querier" containerID="cri-o://a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77" gracePeriod=30
Oct 30 20:50:35.797443 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.797409    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 20:50:35.800090 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.800060    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:35.848875 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.848843    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 20:50:35.856628 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.856601    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 20:50:35.868200 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.867238    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 20:50:35.930965 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.930945    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"
Oct 30 20:50:35.955796 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.955778    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 20:50:35.955999 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.955983    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 20:50:35.956238 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.956212    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 20:50:35.956238 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.956230    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-87trm\""
Oct 30 20:50:35.956365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.956238    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 20:50:35.956365 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.956218    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 20:50:35.956432 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.956403    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 20:50:35.956465 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:35.956443    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 20:50:36.013176 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013153    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e1fb953-b578-4c5f-85d0-47aa86273309-kube-api-access-vf8n7\" (UniqueName: \"kubernetes.io/projected/8e1fb953-b578-4c5f-85d0-47aa86273309-kube-api-access-vf8n7\") pod \"8e1fb953-b578-4c5f-85d0-47aa86273309\" (UID: \"8e1fb953-b578-4c5f-85d0-47aa86273309\") "
Oct 30 20:50:36.013272 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013252    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c675992-264e-44f0-beb2-f3bc0e356789-config-out\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013335 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013272    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013335 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013293    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013335 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013307    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013335 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013327    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srdv6\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-kube-api-access-srdv6\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013517 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013485    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013607 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013528    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-tls-assets\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013649 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013624    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013692 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013674    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013753 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013740    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013816 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013794    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.013875 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.013853    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.015289 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.015267    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e1fb953-b578-4c5f-85d0-47aa86273309-kube-api-access-vf8n7" pod "8e1fb953-b578-4c5f-85d0-47aa86273309" (UID: "8e1fb953-b578-4c5f-85d0-47aa86273309"). InnerVolumeSpecName "kube-api-access-vf8n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:50:36.115075 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115038    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115244 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115087    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115244 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115229    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115369 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115296    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c675992-264e-44f0-beb2-f3bc0e356789-config-out\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115369 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115330    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115369 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115358    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115556 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115382    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115556 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115417    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srdv6\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-kube-api-access-srdv6\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115556 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115453    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115556 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115490    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-tls-assets\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115774 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115561    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115774 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115623    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.115774 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.115686    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf8n7\" (UniqueName: \"kubernetes.io/projected/8e1fb953-b578-4c5f-85d0-47aa86273309-kube-api-access-vf8n7\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:50:36.116584 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.116033    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.116584 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.116386    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.117627 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.117594    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.118806 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.118759    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.119063 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.119015    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.119309 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.119283    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.119645 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.119622    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c675992-264e-44f0-beb2-f3bc0e356789-config-out\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.119849 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.119819    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-tls-assets\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.119924 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.119860    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.120352 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.120330    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.120498 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.120484    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.177844 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.177823    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srdv6\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-kube-api-access-srdv6\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:36.352125 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.352062    5937 generic.go:356] "Generic (PLEG): container finished" podID="8e1fb953-b578-4c5f-85d0-47aa86273309" containerID="a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77" exitCode=0
Oct 30 20:50:36.352125 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.352108    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"
Oct 30 20:50:36.352250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.352124    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5" event={"ID":"8e1fb953-b578-4c5f-85d0-47aa86273309","Type":"ContainerDied","Data":"a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77"}
Oct 30 20:50:36.352250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.352163    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5" event={"ID":"8e1fb953-b578-4c5f-85d0-47aa86273309","Type":"ContainerDied","Data":"d35a58c2d2e5416250caf8743a0ee78790f0f6c648f12d0322fd1ef90b042318"}
Oct 30 20:50:36.352250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.352182    5937 scope.go:122] "RemoveContainer" containerID="a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77"
Oct 30 20:50:36.360724 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.360708    5937 scope.go:122] "RemoveContainer" containerID="a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77"
Oct 30 20:50:36.360998 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:50:36.360976    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77\": container with ID starting with a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77 not found: ID does not exist" containerID="a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77"
Oct 30 20:50:36.361099 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.361005    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77"} err="failed to get container status \"a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77\": rpc error: code = NotFound desc = could not find container \"a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77\": container with ID starting with a467247f2e83a1425024f15fa3a2a5c1cb20931209d54771240fd9dad2815b77 not found: ID does not exist"
Oct 30 20:50:36.519071 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.519047    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"]
Oct 30 20:50:36.522273 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:36.522254    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-49mm5"]
Oct 30 20:50:37.160904 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:37.160872    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e1fb953-b578-4c5f-85d0-47aa86273309" path="/var/lib/kubelet/pods/8e1fb953-b578-4c5f-85d0-47aa86273309/volumes"
Oct 30 20:50:38.318842 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:38.318816    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:50:45.671049 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:50:45.670967    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:50:46.129928 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:46.129898    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:46.245451 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:46.245421    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:46.331030 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:46.330994    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:46.331165 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:46.331142    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:46.384958 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:46.384899    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") DevicePath \"csi-b22ad38bf3b4f4bc597b0714ae5f5e5b02f893b6e7c82d1e64089686a83f348c\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:46.593244 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:46.593209    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/6dcee51846c65e61e42d030ad34b511007d41c5710f282a3474b3969662e5f6c/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:46.655986 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:46.655934    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:46.916057 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:46.915981    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:50:47.446217 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:50:47.446179    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c675992_264e_44f0_beb2_f3bc0e356789.slice/crio-6497b8cac6b1e975ae0dbf8cf5d5e6e094746282006af8a350430d0d6a066347 WatchSource:0}: Error finding container 6497b8cac6b1e975ae0dbf8cf5d5e6e094746282006af8a350430d0d6a066347: Status 404 returned error can't find the container with id 6497b8cac6b1e975ae0dbf8cf5d5e6e094746282006af8a350430d0d6a066347
Oct 30 20:50:47.473378 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:47.473352    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 20:50:48.413649 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:48.413613    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerStarted","Data":"6497b8cac6b1e975ae0dbf8cf5d5e6e094746282006af8a350430d0d6a066347"}
Oct 30 20:50:51.427648 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:51.427611    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerStarted","Data":"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"}
Oct 30 20:50:54.442207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:54.442135    5937 generic.go:356] "Generic (PLEG): container finished" podID="5c675992-264e-44f0-beb2-f3bc0e356789" containerID="da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9" exitCode=0
Oct 30 20:50:54.442207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:54.442178    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerDied","Data":"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"}
Oct 30 20:50:54.443305 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:54.443290    5937 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:50:59.468753 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:50:59.468722    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerStarted","Data":"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"}
Oct 30 20:51:00.474953 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:00.474919    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerStarted","Data":"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"}
Oct 30 20:51:00.475327 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:00.474976    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerStarted","Data":"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"}
Oct 30 20:51:00.749116 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:00.749020    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podStartSLOduration=17.559518871999998 podStartE2EDuration="28.749006105s" totalImagesPullingTime="7.805076743s" totalInitContainerRuntime="3.38441049s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:50:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:51:00.698001563 +0000 UTC m=+835.654016373" watchObservedRunningTime="2026-10-30 20:51:00.749006105 +0000 UTC m=+835.705020877"
Oct 30 20:51:01.917022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:01.916975    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:51:01.917453 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:01.917067    5937 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:51:01.922364 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:01.922344    5937 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:51:02.489058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:02.489033    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:51:12.829696 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:12.829665    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 20:51:12.830240 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:12.829933    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="prometheus" containerID="cri-o://188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982" gracePeriod=600
Oct 30 20:51:12.830240 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:12.829963    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="thanos-sidecar" containerID="cri-o://c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d" gracePeriod=600
Oct 30 20:51:12.830240 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:12.830007    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="config-reloader" containerID="cri-o://0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881" gracePeriod=600
Oct 30 20:51:13.081444 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.081380    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:51:13.176406 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176378    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.176621 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176411    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.176621 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176432    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5c675992-264e-44f0-beb2-f3bc0e356789-config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c675992-264e-44f0-beb2-f3bc0e356789-config-out\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.176621 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176456    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.176621 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176519    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.176621 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176563    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-thanos-prometheus-http-client-file\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.176621 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176590    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-secret-prometheus-web-tls-ca\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.176974 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176794    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-1" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:13.176974 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176809    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-2" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:13.176974 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176851    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-kube-api-access-srdv6\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-kube-api-access-srdv6\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.176974 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.176961    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.177274 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.177047    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-tls-assets\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-tls-assets\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.177274 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.177087    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-config\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.177274 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.177127    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.177274 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.177157    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config\") pod \"5c675992-264e-44f0-beb2-f3bc0e356789\" (UID: \"5c675992-264e-44f0-beb2-f3bc0e356789\") "
Oct 30 20:51:13.177568 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.177531    5937 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.177667 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.177569    5937 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.178196 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.178110    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-0" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:13.179554 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.179502    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-secret-prometheus-web-tls-ca" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:13.179848 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.179820    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:13.180022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.179995    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c675992-264e-44f0-beb2-f3bc0e356789-config-out" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:13.180152 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.179997    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:13.180152 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.180142    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-kube-api-access-srdv6" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "kube-api-access-srdv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:13.180357 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.180338    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-config" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:13.180591 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.180569    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-thanos-prometheus-http-client-file" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:13.180901 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.180883    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-tls-assets" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:13.183939 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.183918    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 20:51:13.192761 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.192739    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config" pod "5c675992-264e-44f0-beb2-f3bc0e356789" (UID: "5c675992-264e-44f0-beb2-f3bc0e356789"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:13.278625 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278595    5937 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-tls-assets\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278625 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278622    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278625 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278632    5937 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5c675992-264e-44f0-beb2-f3bc0e356789-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278917 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278642    5937 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278917 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278650    5937 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c675992-264e-44f0-beb2-f3bc0e356789-config-out\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278917 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278659    5937 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278917 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278671    5937 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278917 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278683    5937 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278917 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278692    5937 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/5c675992-264e-44f0-beb2-f3bc0e356789-secret-prometheus-web-tls-ca\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278917 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278700    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srdv6\" (UniqueName: \"kubernetes.io/projected/5c675992-264e-44f0-beb2-f3bc0e356789-kube-api-access-srdv6\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:13.278917 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.278728    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 20:51:13.292226 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.292208    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:51:13.379861 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.379779    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-b22ad38bf3b4f4bc597b0714ae5f5e5b02f893b6e7c82d1e64089686a83f348c\""
Oct 30 20:51:13.540346 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.540309    5937 generic.go:356] "Generic (PLEG): container finished" podID="5c675992-264e-44f0-beb2-f3bc0e356789" containerID="c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d" exitCode=0
Oct 30 20:51:13.540346 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.540336    5937 generic.go:356] "Generic (PLEG): container finished" podID="5c675992-264e-44f0-beb2-f3bc0e356789" containerID="0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881" exitCode=0
Oct 30 20:51:13.540346 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.540345    5937 generic.go:356] "Generic (PLEG): container finished" podID="5c675992-264e-44f0-beb2-f3bc0e356789" containerID="188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982" exitCode=0
Oct 30 20:51:13.540646 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.540375    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:51:13.540646 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.540386    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerDied","Data":"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"}
Oct 30 20:51:13.540646 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.540454    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerDied","Data":"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"}
Oct 30 20:51:13.540646 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.540481    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerDied","Data":"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"}
Oct 30 20:51:13.540646 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.540504    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"5c675992-264e-44f0-beb2-f3bc0e356789","Type":"ContainerDied","Data":"6497b8cac6b1e975ae0dbf8cf5d5e6e094746282006af8a350430d0d6a066347"}
Oct 30 20:51:13.540646 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.540526    5937 scope.go:122] "RemoveContainer" containerID="c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"
Oct 30 20:51:13.551754 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.551730    5937 scope.go:122] "RemoveContainer" containerID="0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"
Oct 30 20:51:13.560294 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.560270    5937 scope.go:122] "RemoveContainer" containerID="188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"
Oct 30 20:51:13.568055 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.568038    5937 scope.go:122] "RemoveContainer" containerID="da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"
Oct 30 20:51:13.575244 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.575215    5937 scope.go:122] "RemoveContainer" containerID="c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"
Oct 30 20:51:13.575523 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:51:13.575496    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d\": container with ID starting with c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d not found: ID does not exist" containerID="c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"
Oct 30 20:51:13.575598 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.575552    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"} err="failed to get container status \"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d\": rpc error: code = NotFound desc = could not find container \"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d\": container with ID starting with c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d not found: ID does not exist"
Oct 30 20:51:13.575598 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.575580    5937 scope.go:122] "RemoveContainer" containerID="0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"
Oct 30 20:51:13.575841 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:51:13.575823    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881\": container with ID starting with 0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881 not found: ID does not exist" containerID="0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"
Oct 30 20:51:13.575884 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.575848    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"} err="failed to get container status \"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881\": rpc error: code = NotFound desc = could not find container \"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881\": container with ID starting with 0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881 not found: ID does not exist"
Oct 30 20:51:13.575884 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.575865    5937 scope.go:122] "RemoveContainer" containerID="188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"
Oct 30 20:51:13.576074 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:51:13.576058    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982\": container with ID starting with 188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982 not found: ID does not exist" containerID="188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"
Oct 30 20:51:13.576114 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.576079    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"} err="failed to get container status \"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982\": rpc error: code = NotFound desc = could not find container \"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982\": container with ID starting with 188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982 not found: ID does not exist"
Oct 30 20:51:13.576114 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.576092    5937 scope.go:122] "RemoveContainer" containerID="da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"
Oct 30 20:51:13.576321 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:51:13.576300    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9\": container with ID starting with da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9 not found: ID does not exist" containerID="da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"
Oct 30 20:51:13.576359 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.576328    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"} err="failed to get container status \"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9\": rpc error: code = NotFound desc = could not find container \"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9\": container with ID starting with da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9 not found: ID does not exist"
Oct 30 20:51:13.576359 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.576342    5937 scope.go:122] "RemoveContainer" containerID="c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"
Oct 30 20:51:13.576559 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.576529    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"} err="failed to get container status \"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d\": rpc error: code = NotFound desc = could not find container \"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d\": container with ID starting with c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d not found: ID does not exist"
Oct 30 20:51:13.576607 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.576559    5937 scope.go:122] "RemoveContainer" containerID="0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"
Oct 30 20:51:13.576949 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.576933    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"} err="failed to get container status \"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881\": rpc error: code = NotFound desc = could not find container \"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881\": container with ID starting with 0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881 not found: ID does not exist"
Oct 30 20:51:13.576949 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.576947    5937 scope.go:122] "RemoveContainer" containerID="188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"
Oct 30 20:51:13.577129 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577111    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"} err="failed to get container status \"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982\": rpc error: code = NotFound desc = could not find container \"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982\": container with ID starting with 188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982 not found: ID does not exist"
Oct 30 20:51:13.577166 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577129    5937 scope.go:122] "RemoveContainer" containerID="da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"
Oct 30 20:51:13.577312 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577293    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"} err="failed to get container status \"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9\": rpc error: code = NotFound desc = could not find container \"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9\": container with ID starting with da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9 not found: ID does not exist"
Oct 30 20:51:13.577396 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577313    5937 scope.go:122] "RemoveContainer" containerID="c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"
Oct 30 20:51:13.577487 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577471    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d"} err="failed to get container status \"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d\": rpc error: code = NotFound desc = could not find container \"c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d\": container with ID starting with c55bc5c67a6a125f62c2ba919760db9dbcc5bc5620160d4211b9d5954b19236d not found: ID does not exist"
Oct 30 20:51:13.577528 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577487    5937 scope.go:122] "RemoveContainer" containerID="0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"
Oct 30 20:51:13.577700 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577685    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881"} err="failed to get container status \"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881\": rpc error: code = NotFound desc = could not find container \"0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881\": container with ID starting with 0f52f7977f5d46fc710937e6e65b2c34a48fda4b3de364817cb4b42694377881 not found: ID does not exist"
Oct 30 20:51:13.577743 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577700    5937 scope.go:122] "RemoveContainer" containerID="188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"
Oct 30 20:51:13.577926 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577909    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982"} err="failed to get container status \"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982\": rpc error: code = NotFound desc = could not find container \"188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982\": container with ID starting with 188ff45f67ceac50b910b2891b89306128cc5d71ec9a458a298e5382e75d7982 not found: ID does not exist"
Oct 30 20:51:13.577974 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.577925    5937 scope.go:122] "RemoveContainer" containerID="da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"
Oct 30 20:51:13.578114 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.578099    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9"} err="failed to get container status \"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9\": rpc error: code = NotFound desc = could not find container \"da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9\": container with ID starting with da1c4a20ec62d6ec137ca18df3e2024dfeb7a024abea820c25c35150a34df8c9 not found: ID does not exist"
Oct 30 20:51:13.711238 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.711204    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 20:51:13.761184 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:13.761152    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 20:51:15.162064 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.162035    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" path="/var/lib/kubelet/pods/5c675992-264e-44f0-beb2-f3bc0e356789/volumes"
Oct 30 20:51:15.175042 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.175018    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"]
Oct 30 20:51:15.175234 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.175213    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs" podUID="129aff5b-f0a1-426c-9db6-b3ea65dd7e86" containerName="ta-container" containerID="cri-o://d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7" gracePeriod=30
Oct 30 20:51:15.413833 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.413776    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:51:15.497281 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.497252    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-ta-internal\" (UniqueName: \"kubernetes.io/configmap/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-ta-internal\") pod \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") "
Oct 30 20:51:15.497442 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.497337    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-kube-api-access-mphj8\" (UniqueName: \"kubernetes.io/projected/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-kube-api-access-mphj8\") pod \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") "
Oct 30 20:51:15.497442 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.497417    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-data-science-collector-ta-server-cert\") pod \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\" (UID: \"129aff5b-f0a1-426c-9db6-b3ea65dd7e86\") "
Oct 30 20:51:15.497677 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.497653    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-ta-internal" pod "129aff5b-f0a1-426c-9db6-b3ea65dd7e86" (UID: "129aff5b-f0a1-426c-9db6-b3ea65dd7e86"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:15.499690 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.499662    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-data-science-collector-ta-server-cert" pod "129aff5b-f0a1-426c-9db6-b3ea65dd7e86" (UID: "129aff5b-f0a1-426c-9db6-b3ea65dd7e86"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:51:15.499902 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.499877    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-kube-api-access-mphj8" pod "129aff5b-f0a1-426c-9db6-b3ea65dd7e86" (UID: "129aff5b-f0a1-426c-9db6-b3ea65dd7e86"). InnerVolumeSpecName "kube-api-access-mphj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:15.552199 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.552166    5937 generic.go:356] "Generic (PLEG): container finished" podID="129aff5b-f0a1-426c-9db6-b3ea65dd7e86" containerID="d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7" exitCode=0
Oct 30 20:51:15.552347 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.552252    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"
Oct 30 20:51:15.552347 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.552263    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs" event={"ID":"129aff5b-f0a1-426c-9db6-b3ea65dd7e86","Type":"ContainerDied","Data":"d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7"}
Oct 30 20:51:15.552347 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.552322    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs" event={"ID":"129aff5b-f0a1-426c-9db6-b3ea65dd7e86","Type":"ContainerDied","Data":"4d74ce08c2ba17eec64afab885c5359d852755249afd0e1dcad6c19cb53d73be"}
Oct 30 20:51:15.552347 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.552343    5937 scope.go:122] "RemoveContainer" containerID="d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7"
Oct 30 20:51:15.564209 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.564182    5937 scope.go:122] "RemoveContainer" containerID="d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7"
Oct 30 20:51:15.564516 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:51:15.564493    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7\": container with ID starting with d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7 not found: ID does not exist" containerID="d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7"
Oct 30 20:51:15.564634 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.564528    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7"} err="failed to get container status \"d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7\": rpc error: code = NotFound desc = could not find container \"d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7\": container with ID starting with d2fbb97d70d041a06df583126d88d4c4956698c4702b7250fae3e2577b56e8e7 not found: ID does not exist"
Oct 30 20:51:15.570328 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.570307    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:51:15.570484 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.570468    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="1f9dde64-7266-419e-afd0-39eb30a5139a" containerName="perses" containerID="cri-o://94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a" gracePeriod=30
Oct 30 20:51:15.598405 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.598382    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:15.598405 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.598405    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:15.598583 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.598417    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mphj8\" (UniqueName: \"kubernetes.io/projected/129aff5b-f0a1-426c-9db6-b3ea65dd7e86-kube-api-access-mphj8\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:15.670494 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:51:15.670424    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:51:15.719746 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.719719    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"]
Oct 30 20:51:15.725691 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.725668    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-585d475bc4-8p6hs"]
Oct 30 20:51:15.804505 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.804483    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:15.899698 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.899668    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f9dde64-7266-419e-afd0-39eb30a5139a-kube-api-access-8nh22\" (UniqueName: \"kubernetes.io/projected/1f9dde64-7266-419e-afd0-39eb30a5139a-kube-api-access-8nh22\") pod \"1f9dde64-7266-419e-afd0-39eb30a5139a\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") "
Oct 30 20:51:15.899875 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.899747    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f9dde64-7266-419e-afd0-39eb30a5139a-plugins\" (UniqueName: \"kubernetes.io/empty-dir/1f9dde64-7266-419e-afd0-39eb30a5139a-plugins\") pod \"1f9dde64-7266-419e-afd0-39eb30a5139a\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") "
Oct 30 20:51:15.899875 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.899773    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1f9dde64-7266-419e-afd0-39eb30a5139a-config\" (UniqueName: \"kubernetes.io/configmap/1f9dde64-7266-419e-afd0-39eb30a5139a-config\") pod \"1f9dde64-7266-419e-afd0-39eb30a5139a\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") "
Oct 30 20:51:15.899875 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.899862    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"1f9dde64-7266-419e-afd0-39eb30a5139a\" (UID: \"1f9dde64-7266-419e-afd0-39eb30a5139a\") "
Oct 30 20:51:15.900167 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.900146    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f9dde64-7266-419e-afd0-39eb30a5139a-config" pod "1f9dde64-7266-419e-afd0-39eb30a5139a" (UID: "1f9dde64-7266-419e-afd0-39eb30a5139a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:51:15.902035 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.902009    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f9dde64-7266-419e-afd0-39eb30a5139a-kube-api-access-8nh22" pod "1f9dde64-7266-419e-afd0-39eb30a5139a" (UID: "1f9dde64-7266-419e-afd0-39eb30a5139a"). InnerVolumeSpecName "kube-api-access-8nh22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:51:15.902803 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:15.902786    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "1f9dde64-7266-419e-afd0-39eb30a5139a" (UID: "1f9dde64-7266-419e-afd0-39eb30a5139a"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 20:51:16.000522 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.000491    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1f9dde64-7266-419e-afd0-39eb30a5139a-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:16.000702 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.000547    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 20:51:16.000702 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.000560    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nh22\" (UniqueName: \"kubernetes.io/projected/1f9dde64-7266-419e-afd0-39eb30a5139a-kube-api-access-8nh22\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:16.014602 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.014583    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:51:16.046851 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.046825    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f9dde64-7266-419e-afd0-39eb30a5139a-plugins" pod "1f9dde64-7266-419e-afd0-39eb30a5139a" (UID: "1f9dde64-7266-419e-afd0-39eb30a5139a"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:51:16.101388 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.101357    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/1f9dde64-7266-419e-afd0-39eb30a5139a-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:51:16.101388 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.101385    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 20:51:16.557732 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.557693    5937 generic.go:356] "Generic (PLEG): container finished" podID="1f9dde64-7266-419e-afd0-39eb30a5139a" containerID="94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a" exitCode=0
Oct 30 20:51:16.558229 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.557743    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:16.558229 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.557781    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"1f9dde64-7266-419e-afd0-39eb30a5139a","Type":"ContainerDied","Data":"94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a"}
Oct 30 20:51:16.558229 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.557822    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"1f9dde64-7266-419e-afd0-39eb30a5139a","Type":"ContainerDied","Data":"1b47774270b8e84300dc50761644e6dac14ce4c3583c019809eb04c815131b3f"}
Oct 30 20:51:16.558229 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.557839    5937 scope.go:122] "RemoveContainer" containerID="94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a"
Oct 30 20:51:16.566883 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.566867    5937 scope.go:122] "RemoveContainer" containerID="94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a"
Oct 30 20:51:16.567175 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:51:16.567158    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a\": container with ID starting with 94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a not found: ID does not exist" containerID="94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a"
Oct 30 20:51:16.567222 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.567183    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a"} err="failed to get container status \"94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a\": rpc error: code = NotFound desc = could not find container \"94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a\": container with ID starting with 94e4a23dc051856e08b602078f196fadce0f541d1de07cce332142c6600dff4a not found: ID does not exist"
Oct 30 20:51:16.729264 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.729232    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:51:16.779925 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:16.779902    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:51:17.160244 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:17.160211    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="129aff5b-f0a1-426c-9db6-b3ea65dd7e86" path="/var/lib/kubelet/pods/129aff5b-f0a1-426c-9db6-b3ea65dd7e86/volumes"
Oct 30 20:51:17.160620 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:17.160607    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1f9dde64-7266-419e-afd0-39eb30a5139a" path="/var/lib/kubelet/pods/1f9dde64-7266-419e-afd0-39eb30a5139a/volumes"
Oct 30 20:51:25.600507 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.600467    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.600909    5937 cpu_manager.go:414] "containerMap: removing container" podUID="1f9dde64-7266-419e-afd0-39eb30a5139a" containerName="perses"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.600923    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f9dde64-7266-419e-afd0-39eb30a5139a" containerName="perses"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.600944    5937 cpu_manager.go:414] "containerMap: removing container" podUID="129aff5b-f0a1-426c-9db6-b3ea65dd7e86" containerName="ta-container"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.600949    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="129aff5b-f0a1-426c-9db6-b3ea65dd7e86" containerName="ta-container"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.600961    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="thanos-sidecar"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.600967    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="thanos-sidecar"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.600985    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="init-config-reloader"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.600994    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="init-config-reloader"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601004    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="prometheus"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601008    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="prometheus"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601020    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="config-reloader"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601024    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="config-reloader"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601033    5937 cpu_manager.go:414] "containerMap: removing container" podUID="8e1fb953-b578-4c5f-85d0-47aa86273309" containerName="thanos-querier"
Oct 30 20:51:25.601062 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601038    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e1fb953-b578-4c5f-85d0-47aa86273309" containerName="thanos-querier"
Oct 30 20:51:25.601761 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601084    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="129aff5b-f0a1-426c-9db6-b3ea65dd7e86" containerName="ta-container"
Oct 30 20:51:25.601761 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601091    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="thanos-sidecar"
Oct 30 20:51:25.601761 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601098    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="prometheus"
Oct 30 20:51:25.601761 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601104    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5c675992-264e-44f0-beb2-f3bc0e356789" containerName="config-reloader"
Oct 30 20:51:25.601761 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601109    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e1fb953-b578-4c5f-85d0-47aa86273309" containerName="thanos-querier"
Oct 30 20:51:25.601761 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.601115    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f9dde64-7266-419e-afd0-39eb30a5139a" containerName="perses"
Oct 30 20:51:25.604768 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.604749    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:25.655191 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.655153    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:51:25.705010 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.704971    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:51:25.705190 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.705063    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:51:25.705190 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.705102    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 20:51:25.710428 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.710409    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 20:51:25.875955 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.875868    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/df8d5028-be9e-4c2b-9a9c-06a100af4568-plugins\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:25.875955 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.875937    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvrd\" (UniqueName: \"kubernetes.io/projected/df8d5028-be9e-4c2b-9a9c-06a100af4568-kube-api-access-hcvrd\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:25.876138 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.876013    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df8d5028-be9e-4c2b-9a9c-06a100af4568-config\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:25.976894 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.976865    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/df8d5028-be9e-4c2b-9a9c-06a100af4568-plugins\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:25.977025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.976920    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvrd\" (UniqueName: \"kubernetes.io/projected/df8d5028-be9e-4c2b-9a9c-06a100af4568-kube-api-access-hcvrd\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:25.977025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.976949    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df8d5028-be9e-4c2b-9a9c-06a100af4568-config\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:25.977334 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.977315    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/df8d5028-be9e-4c2b-9a9c-06a100af4568-plugins\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:25.977598 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:25.977583    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df8d5028-be9e-4c2b-9a9c-06a100af4568-config\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:26.040091 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:26.040060    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvrd\" (UniqueName: \"kubernetes.io/projected/df8d5028-be9e-4c2b-9a9c-06a100af4568-kube-api-access-hcvrd\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:29.405248 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:29.405212    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:29.512297 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:29.512263    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:29.606416 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:29.606387    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:29.606585 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:29.606517    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:29.660042 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:29.659981    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:29.799143 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:29.799114    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:29.866085 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:29.866059    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:30.116560 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:30.116514    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:30.489709 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:30.489686    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:51:30.491963 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:51:30.491940    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf8d5028_be9e_4c2b_9a9c_06a100af4568.slice/crio-02a48fdef8e492275d220ff9a3ff451d51574c0d1bec21394de41f3d4f315720 WatchSource:0}: Error finding container 02a48fdef8e492275d220ff9a3ff451d51574c0d1bec21394de41f3d4f315720: Status 404 returned error can't find the container with id 02a48fdef8e492275d220ff9a3ff451d51574c0d1bec21394de41f3d4f315720
Oct 30 20:51:30.625733 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:30.625699    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"df8d5028-be9e-4c2b-9a9c-06a100af4568","Type":"ContainerStarted","Data":"535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05"}
Oct 30 20:51:30.625733 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:30.625738    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"df8d5028-be9e-4c2b-9a9c-06a100af4568","Type":"ContainerStarted","Data":"02a48fdef8e492275d220ff9a3ff451d51574c0d1bec21394de41f3d4f315720"}
Oct 30 20:51:30.625976 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:30.625823    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:30.744572 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:30.744453    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=5.744437591 podStartE2EDuration="5.744437591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:51:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:51:30.744380538 +0000 UTC m=+865.700395337" watchObservedRunningTime="2026-10-30 20:51:30.744437591 +0000 UTC m=+865.700452366"
Oct 30 20:51:41.631683 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:51:41.631655    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:51:45.670158 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:51:45.670122    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:52:15.671373 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:52:15.671292    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:52:24.358795 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.358761    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:52:24.359396 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.358997    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="df8d5028-be9e-4c2b-9a9c-06a100af4568" containerName="perses" containerID="cri-o://535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05" gracePeriod=30
Oct 30 20:52:24.602226 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.602204    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:24.761328 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.761297    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"df8d5028-be9e-4c2b-9a9c-06a100af4568\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") "
Oct 30 20:52:24.761505 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.761398    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/df8d5028-be9e-4c2b-9a9c-06a100af4568-plugins\" (UniqueName: \"kubernetes.io/empty-dir/df8d5028-be9e-4c2b-9a9c-06a100af4568-plugins\") pod \"df8d5028-be9e-4c2b-9a9c-06a100af4568\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") "
Oct 30 20:52:24.761505 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.761438    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/df8d5028-be9e-4c2b-9a9c-06a100af4568-config\" (UniqueName: \"kubernetes.io/configmap/df8d5028-be9e-4c2b-9a9c-06a100af4568-config\") pod \"df8d5028-be9e-4c2b-9a9c-06a100af4568\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") "
Oct 30 20:52:24.761505 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.761496    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/df8d5028-be9e-4c2b-9a9c-06a100af4568-kube-api-access-hcvrd\" (UniqueName: \"kubernetes.io/projected/df8d5028-be9e-4c2b-9a9c-06a100af4568-kube-api-access-hcvrd\") pod \"df8d5028-be9e-4c2b-9a9c-06a100af4568\" (UID: \"df8d5028-be9e-4c2b-9a9c-06a100af4568\") "
Oct 30 20:52:24.761952 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.761898    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df8d5028-be9e-4c2b-9a9c-06a100af4568-config" pod "df8d5028-be9e-4c2b-9a9c-06a100af4568" (UID: "df8d5028-be9e-4c2b-9a9c-06a100af4568"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:52:24.764999 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.764971    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "df8d5028-be9e-4c2b-9a9c-06a100af4568" (UID: "df8d5028-be9e-4c2b-9a9c-06a100af4568"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 20:52:24.765754 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.765729    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df8d5028-be9e-4c2b-9a9c-06a100af4568-kube-api-access-hcvrd" pod "df8d5028-be9e-4c2b-9a9c-06a100af4568" (UID: "df8d5028-be9e-4c2b-9a9c-06a100af4568"). InnerVolumeSpecName "kube-api-access-hcvrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:52:24.862217 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.862185    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcvrd\" (UniqueName: \"kubernetes.io/projected/df8d5028-be9e-4c2b-9a9c-06a100af4568-kube-api-access-hcvrd\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:24.862380 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.862229    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 20:52:24.862380 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.862244    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df8d5028-be9e-4c2b-9a9c-06a100af4568-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:24.862589 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.862561    5937 generic.go:356] "Generic (PLEG): container finished" podID="df8d5028-be9e-4c2b-9a9c-06a100af4568" containerID="535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05" exitCode=0
Oct 30 20:52:24.862645 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.862607    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:24.862645 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.862627    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"df8d5028-be9e-4c2b-9a9c-06a100af4568","Type":"ContainerDied","Data":"535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05"}
Oct 30 20:52:24.862717 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.862670    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"df8d5028-be9e-4c2b-9a9c-06a100af4568","Type":"ContainerDied","Data":"02a48fdef8e492275d220ff9a3ff451d51574c0d1bec21394de41f3d4f315720"}
Oct 30 20:52:24.862717 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.862694    5937 scope.go:122] "RemoveContainer" containerID="535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05"
Oct 30 20:52:24.871618 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.871585    5937 scope.go:122] "RemoveContainer" containerID="535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05"
Oct 30 20:52:24.871905 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:52:24.871886    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05\": container with ID starting with 535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05 not found: ID does not exist" containerID="535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05"
Oct 30 20:52:24.871973 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.871915    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05"} err="failed to get container status \"535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05\": rpc error: code = NotFound desc = could not find container \"535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05\": container with ID starting with 535fffff06622b9791508b6654e22d7ddc54584c48bf87611fda85388f8bde05 not found: ID does not exist"
Oct 30 20:52:24.876291 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.876277    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:52:24.908650 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.908623    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df8d5028-be9e-4c2b-9a9c-06a100af4568-plugins" pod "df8d5028-be9e-4c2b-9a9c-06a100af4568" (UID: "df8d5028-be9e-4c2b-9a9c-06a100af4568"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:52:24.962984 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.962958    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/df8d5028-be9e-4c2b-9a9c-06a100af4568-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:52:24.962984 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:24.962981    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 20:52:25.283219 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:25.283187    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:52:25.287527 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:25.287489    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:52:27.160526 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:27.160494    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="df8d5028-be9e-4c2b-9a9c-06a100af4568" path="/var/lib/kubelet/pods/df8d5028-be9e-4c2b-9a9c-06a100af4568/volumes"
Oct 30 20:52:41.217616 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.217586    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"]
Oct 30 20:52:41.218053 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.217947    5937 cpu_manager.go:414] "containerMap: removing container" podUID="df8d5028-be9e-4c2b-9a9c-06a100af4568" containerName="perses"
Oct 30 20:52:41.218053 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.217960    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="df8d5028-be9e-4c2b-9a9c-06a100af4568" containerName="perses"
Oct 30 20:52:41.218053 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.218031    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="df8d5028-be9e-4c2b-9a9c-06a100af4568" containerName="perses"
Oct 30 20:52:41.240044 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.240021    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"
Oct 30 20:52:41.277083 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.277054    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"]
Oct 30 20:52:41.293825 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.293802    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:52:41.296128 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.296102    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgn4p\" (UniqueName: \"kubernetes.io/projected/4f04badb-2cba-495e-8725-b2f180ed5340-kube-api-access-qgn4p\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27\" (UID: \"4f04badb-2cba-495e-8725-b2f180ed5340\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"
Oct 30 20:52:41.327226 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.327204    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:52:41.344431 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.344413    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 20:52:41.397517 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.397491    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgn4p\" (UniqueName: \"kubernetes.io/projected/4f04badb-2cba-495e-8725-b2f180ed5340-kube-api-access-qgn4p\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27\" (UID: \"4f04badb-2cba-495e-8725-b2f180ed5340\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"
Oct 30 20:52:41.460379 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.460355    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgn4p\" (UniqueName: \"kubernetes.io/projected/4f04badb-2cba-495e-8725-b2f180ed5340-kube-api-access-qgn4p\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27\" (UID: \"4f04badb-2cba-495e-8725-b2f180ed5340\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"
Oct 30 20:52:41.553166 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.553099    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"
Oct 30 20:52:41.925395 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.925370    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"]
Oct 30 20:52:41.927776 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:52:41.927746    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f04badb_2cba_495e_8725_b2f180ed5340.slice/crio-52f557b557293123eaa7ca8e4655deb1102743c18acc957070b66c68ef0e2ed9 WatchSource:0}: Error finding container 52f557b557293123eaa7ca8e4655deb1102743c18acc957070b66c68ef0e2ed9: Status 404 returned error can't find the container with id 52f557b557293123eaa7ca8e4655deb1102743c18acc957070b66c68ef0e2ed9
Oct 30 20:52:41.940288 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:41.940263    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27" event={"ID":"4f04badb-2cba-495e-8725-b2f180ed5340","Type":"ContainerStarted","Data":"52f557b557293123eaa7ca8e4655deb1102743c18acc957070b66c68ef0e2ed9"}
Oct 30 20:52:42.945629 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:42.945522    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27" event={"ID":"4f04badb-2cba-495e-8725-b2f180ed5340","Type":"ContainerStarted","Data":"26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee"}
Oct 30 20:52:43.062526 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:43.062479    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27" podStartSLOduration=2.062462322 podStartE2EDuration="2.062462322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:43.062282525 +0000 UTC m=+938.018297301" watchObservedRunningTime="2026-10-30 20:52:43.062462322 +0000 UTC m=+938.018477102"
Oct 30 20:52:44.878526 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:44.878489    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:52:44.881894 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:44.881876    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:44.953859 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:44.953830    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:52:44.987480 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:44.987452    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 20:52:45.078500 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.078475    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"]
Oct 30 20:52:45.081785 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.081769    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.128495 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.128469    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f76666c6-88a7-400d-9175-9bab948c0f91-config\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:45.128682 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.128514    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76666c6-88a7-400d-9175-9bab948c0f91-plugins\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:45.128682 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.128673    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxbpx\" (UniqueName: \"kubernetes.io/projected/f76666c6-88a7-400d-9175-9bab948c0f91-kube-api-access-dxbpx\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:45.135691 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.135663    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 20:52:45.135691 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.135683    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-qj6zl\""
Oct 30 20:52:45.140957 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.140941    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 20:52:45.147149 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.147117    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"]
Oct 30 20:52:45.229729 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.229691    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94zk6\" (UniqueName: \"kubernetes.io/projected/81b5d44f-d306-429c-aa32-b87440e9a28b-kube-api-access-94zk6\") pod \"data-science-collector-targetallocator-55b57b5774-zvhlk\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.229917 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.229752    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxbpx\" (UniqueName: \"kubernetes.io/projected/f76666c6-88a7-400d-9175-9bab948c0f91-kube-api-access-dxbpx\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:45.229986 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.229911    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f76666c6-88a7-400d-9175-9bab948c0f91-config\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:45.229986 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.229957    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76666c6-88a7-400d-9175-9bab948c0f91-plugins\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:45.229986 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.229977    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/81b5d44f-d306-429c-aa32-b87440e9a28b-ta-internal\") pod \"data-science-collector-targetallocator-55b57b5774-zvhlk\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.230125 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.230005    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81b5d44f-d306-429c-aa32-b87440e9a28b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55b57b5774-zvhlk\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.230361 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.230339    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76666c6-88a7-400d-9175-9bab948c0f91-plugins\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:45.230630 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.230614    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f76666c6-88a7-400d-9175-9bab948c0f91-config\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:45.295909 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.295879    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxbpx\" (UniqueName: \"kubernetes.io/projected/f76666c6-88a7-400d-9175-9bab948c0f91-kube-api-access-dxbpx\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:45.330858 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.330833    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94zk6\" (UniqueName: \"kubernetes.io/projected/81b5d44f-d306-429c-aa32-b87440e9a28b-kube-api-access-94zk6\") pod \"data-science-collector-targetallocator-55b57b5774-zvhlk\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.330967 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.330902    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/81b5d44f-d306-429c-aa32-b87440e9a28b-ta-internal\") pod \"data-science-collector-targetallocator-55b57b5774-zvhlk\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.330967 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.330934    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81b5d44f-d306-429c-aa32-b87440e9a28b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55b57b5774-zvhlk\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.331642 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.331624    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/81b5d44f-d306-429c-aa32-b87440e9a28b-ta-internal\") pod \"data-science-collector-targetallocator-55b57b5774-zvhlk\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.333530 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.333509    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81b5d44f-d306-429c-aa32-b87440e9a28b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-55b57b5774-zvhlk\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.397873 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.397812    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94zk6\" (UniqueName: \"kubernetes.io/projected/81b5d44f-d306-429c-aa32-b87440e9a28b-kube-api-access-94zk6\") pod \"data-science-collector-targetallocator-55b57b5774-zvhlk\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:45.671385 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:52:45.671289    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:52:45.692672 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:45.692647    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:46.070076 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:46.070056    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"]
Oct 30 20:52:46.072026 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:52:46.072002    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81b5d44f_d306_429c_aa32_b87440e9a28b.slice/crio-1d0779ce375d101b6f6d6df18efac8f95d45f32f0f1598255550ddc52ecae90b WatchSource:0}: Error finding container 1d0779ce375d101b6f6d6df18efac8f95d45f32f0f1598255550ddc52ecae90b: Status 404 returned error can't find the container with id 1d0779ce375d101b6f6d6df18efac8f95d45f32f0f1598255550ddc52ecae90b
Oct 30 20:52:46.074183 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:46.074153    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:52:46.074252 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:46.074211    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:52:46.965722 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:46.965687    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk" event={"ID":"81b5d44f-d306-429c-aa32-b87440e9a28b","Type":"ContainerStarted","Data":"4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e"}
Oct 30 20:52:46.965972 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:46.965734    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk" event={"ID":"81b5d44f-d306-429c-aa32-b87440e9a28b","Type":"ContainerStarted","Data":"1d0779ce375d101b6f6d6df18efac8f95d45f32f0f1598255550ddc52ecae90b"}
Oct 30 20:52:46.965972 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:46.965839    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:46.966768 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:46.966744    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk" podUID="81b5d44f-d306-429c-aa32-b87440e9a28b" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.31:8080/readyz\": dial tcp 10.134.0.31:8080: connect: connection refused"
Oct 30 20:52:47.086680 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:47.086630    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk" podStartSLOduration=2.086616848 podStartE2EDuration="2.086616848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:47.085670273 +0000 UTC m=+942.041685068" watchObservedRunningTime="2026-10-30 20:52:47.086616848 +0000 UTC m=+942.042631621"
Oct 30 20:52:47.971430 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:47.971406    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:52:49.062458 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:49.062387    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:49.169300 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:49.169277    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:49.264745 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:49.264718    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:49.264905 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:49.264861    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:49.317915 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:49.317860    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:49.457635 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:49.457599    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:49.528186 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:49.528146    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:49.693786 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:49.693708    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:50.067164 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:50.067072    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:52:50.069975 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:52:50.069948    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf76666c6_88a7_400d_9175_9bab948c0f91.slice/crio-95b6fe08d000af325c86f145d5b916026760dc332736d64b60ba5843127af1b6 WatchSource:0}: Error finding container 95b6fe08d000af325c86f145d5b916026760dc332736d64b60ba5843127af1b6: Status 404 returned error can't find the container with id 95b6fe08d000af325c86f145d5b916026760dc332736d64b60ba5843127af1b6
Oct 30 20:52:50.985015 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:50.984980    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f76666c6-88a7-400d-9175-9bab948c0f91","Type":"ContainerStarted","Data":"0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba"}
Oct 30 20:52:50.985207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:50.985029    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f76666c6-88a7-400d-9175-9bab948c0f91","Type":"ContainerStarted","Data":"95b6fe08d000af325c86f145d5b916026760dc332736d64b60ba5843127af1b6"}
Oct 30 20:52:50.985207 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:50.985116    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:52:51.104506 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:51.104459    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=7.104443861 podStartE2EDuration="7.104443861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:52:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:51.103610256 +0000 UTC m=+946.059625227" watchObservedRunningTime="2026-10-30 20:52:51.104443861 +0000 UTC m=+946.060458636"
Oct 30 20:52:57.403267 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:57.403234    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"]
Oct 30 20:52:57.424910 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:57.424886    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"
Oct 30 20:52:57.464571 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:57.464519    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"]
Oct 30 20:52:57.543229 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:57.543202    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn5s4\" (UniqueName: \"kubernetes.io/projected/c4687532-280b-4005-9197-2205a3adf8b2-kube-api-access-gn5s4\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vn299\" (UID: \"c4687532-280b-4005-9197-2205a3adf8b2\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"
Oct 30 20:52:57.644225 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:57.644192    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn5s4\" (UniqueName: \"kubernetes.io/projected/c4687532-280b-4005-9197-2205a3adf8b2-kube-api-access-gn5s4\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vn299\" (UID: \"c4687532-280b-4005-9197-2205a3adf8b2\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"
Oct 30 20:52:57.707311 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:57.707286    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn5s4\" (UniqueName: \"kubernetes.io/projected/c4687532-280b-4005-9197-2205a3adf8b2-kube-api-access-gn5s4\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vn299\" (UID: \"c4687532-280b-4005-9197-2205a3adf8b2\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"
Oct 30 20:52:57.736521 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:57.736493    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"
Oct 30 20:52:58.106782 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:58.106734    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"]
Oct 30 20:52:58.108833 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:52:58.108798    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4687532_280b_4005_9197_2205a3adf8b2.slice/crio-c693066ac0516b8b59adc3ccf33f859926c5f6783e4845f1b23a0ca44af3898b WatchSource:0}: Error finding container c693066ac0516b8b59adc3ccf33f859926c5f6783e4845f1b23a0ca44af3898b: Status 404 returned error can't find the container with id c693066ac0516b8b59adc3ccf33f859926c5f6783e4845f1b23a0ca44af3898b
Oct 30 20:52:59.022953 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.022916    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299" event={"ID":"c4687532-280b-4005-9197-2205a3adf8b2","Type":"ContainerStarted","Data":"affabbd71eec1a47924e08d0f1614a4df604dc2b61a744c61c88fb91fbee389a"}
Oct 30 20:52:59.023387 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.022968    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299" event={"ID":"c4687532-280b-4005-9197-2205a3adf8b2","Type":"ContainerStarted","Data":"c693066ac0516b8b59adc3ccf33f859926c5f6783e4845f1b23a0ca44af3898b"}
Oct 30 20:52:59.133718 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.133688    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 20:52:59.137439 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.137422    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.184161 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.184110    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299" podStartSLOduration=2.184097886 podStartE2EDuration="2.184097886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:52:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:52:59.183780242 +0000 UTC m=+954.139795019" watchObservedRunningTime="2026-10-30 20:52:59.184097886 +0000 UTC m=+954.140112662"
Oct 30 20:52:59.185404 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.185381    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"]
Oct 30 20:52:59.185616 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.185595    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27" podUID="4f04badb-2cba-495e-8725-b2f180ed5340" containerName="thanos-querier" containerID="cri-o://26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee" gracePeriod=30
Oct 30 20:52:59.202360 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.202130    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 20:52:59.202360 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.202277    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 20:52:59.202360 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.202332    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 20:52:59.235634 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.235607    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 20:52:59.252994 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.252961    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 20:52:59.252994 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.252968    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 20:52:59.252994 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.252992    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 20:52:59.253198 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.253117    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-t5vs6\""
Oct 30 20:52:59.253198 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.253189    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 20:52:59.253280 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.253221    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 20:52:59.253280 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.253224    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 20:52:59.359391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359226    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359283    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359309    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359326    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359357    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359390    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359771 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359437    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359771 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359464    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc91b113-6937-416a-8827-f4a0909241f7-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359771 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359519    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359771 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359583    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359771 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359618    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.359771 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.359665    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwh5\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-kube-api-access-rtwh5\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.425653 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.425626    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"
Oct 30 20:52:59.460485 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460458    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.460662 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460494    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc91b113-6937-416a-8827-f4a0909241f7-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.460662 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460532    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.460662 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460591    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.460662 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460621    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.460892 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460725    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwh5\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-kube-api-access-rtwh5\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.460892 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460822    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.460892 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460888    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.461070 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460917    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.461070 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.460935    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.461200 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.461170    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.461324 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.461236    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.463346 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.463315    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.463748 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.463718    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.463886 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.463861    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.464562 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.464507    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.465783 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.465747    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-tls-assets\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.465882 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.465823    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.472024 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.467387    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-config\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.472777 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.472700    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc91b113-6937-416a-8827-f4a0909241f7-config-out\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.473738 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.473717    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.474036 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.474014    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.474515 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.474493    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.524343 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.524315    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwh5\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-kube-api-access-rtwh5\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:52:59.562441 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.562378    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f04badb-2cba-495e-8725-b2f180ed5340-kube-api-access-qgn4p\" (UniqueName: \"kubernetes.io/projected/4f04badb-2cba-495e-8725-b2f180ed5340-kube-api-access-qgn4p\") pod \"4f04badb-2cba-495e-8725-b2f180ed5340\" (UID: \"4f04badb-2cba-495e-8725-b2f180ed5340\") "
Oct 30 20:52:59.564368 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.564345    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f04badb-2cba-495e-8725-b2f180ed5340-kube-api-access-qgn4p" pod "4f04badb-2cba-495e-8725-b2f180ed5340" (UID: "4f04badb-2cba-495e-8725-b2f180ed5340"). InnerVolumeSpecName "kube-api-access-qgn4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:52:59.663680 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:52:59.663649    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgn4p\" (UniqueName: \"kubernetes.io/projected/4f04badb-2cba-495e-8725-b2f180ed5340-kube-api-access-qgn4p\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:00.028594 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:00.028531    5937 generic.go:356] "Generic (PLEG): container finished" podID="4f04badb-2cba-495e-8725-b2f180ed5340" containerID="26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee" exitCode=0
Oct 30 20:53:00.028594 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:00.028571    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27" event={"ID":"4f04badb-2cba-495e-8725-b2f180ed5340","Type":"ContainerDied","Data":"26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee"}
Oct 30 20:53:00.029105 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:00.028611    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"
Oct 30 20:53:00.029105 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:00.028625    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27" event={"ID":"4f04badb-2cba-495e-8725-b2f180ed5340","Type":"ContainerDied","Data":"52f557b557293123eaa7ca8e4655deb1102743c18acc957070b66c68ef0e2ed9"}
Oct 30 20:53:00.029105 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:00.028649    5937 scope.go:122] "RemoveContainer" containerID="26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee"
Oct 30 20:53:00.037221 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:00.037207    5937 scope.go:122] "RemoveContainer" containerID="26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee"
Oct 30 20:53:00.037452 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:53:00.037433    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee\": container with ID starting with 26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee not found: ID does not exist" containerID="26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee"
Oct 30 20:53:00.037569 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:00.037460    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee"} err="failed to get container status \"26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee\": rpc error: code = NotFound desc = could not find container \"26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee\": container with ID starting with 26a57a4fd7e62d47768c71a5699e63e758d5b5bee00b94a3edff61edbc4593ee not found: ID does not exist"
Oct 30 20:53:00.197959 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:00.197928    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"]
Oct 30 20:53:00.201688 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:00.201663    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-vvr27"]
Oct 30 20:53:01.160929 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:01.160899    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f04badb-2cba-495e-8725-b2f180ed5340" path="/var/lib/kubelet/pods/4f04badb-2cba-495e-8725-b2f180ed5340/volumes"
Oct 30 20:53:01.579484 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:01.579453    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:01.686334 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:01.686305    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:01.781521 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:01.781490    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:01.781680 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:01.781631    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:01.834489 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:01.834428    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") DevicePath \"csi-ba332f9bf0d1b4a6d9e8dc7e3ea187b96ae03f9eff9e13fdbc24ad7be374242c\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:01.974932 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:01.974897    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/fb02f91ab75afdcfd8c2ac3eaeb0ba7303c67490d38fe3164f5fc7856f2f1875/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:01.992582 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:01.992557    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:53:02.043255 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:02.043225    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"prometheus-data-science-monitoringstack-0\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:02.156563 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:02.156481    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:02.649409 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:02.649380    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 20:53:02.680053 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:53:02.680028    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc91b113_6937_416a_8827_f4a0909241f7.slice/crio-35014ce05cb096e0914a4d36b4d37df971df384b1f16edb44f5eedeed791c718 WatchSource:0}: Error finding container 35014ce05cb096e0914a4d36b4d37df971df384b1f16edb44f5eedeed791c718: Status 404 returned error can't find the container with id 35014ce05cb096e0914a4d36b4d37df971df384b1f16edb44f5eedeed791c718
Oct 30 20:53:03.044254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:03.044218    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerStarted","Data":"35014ce05cb096e0914a4d36b4d37df971df384b1f16edb44f5eedeed791c718"}
Oct 30 20:53:04.050442 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:04.050410    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerStarted","Data":"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"}
Oct 30 20:53:07.064448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:07.064417    5937 generic.go:356] "Generic (PLEG): container finished" podID="fc91b113-6937-416a-8827-f4a0909241f7" containerID="0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f" exitCode=0
Oct 30 20:53:07.064830 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:07.064469    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerDied","Data":"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"}
Oct 30 20:53:08.071529 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:08.071480    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerStarted","Data":"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"}
Oct 30 20:53:08.071915 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:08.071607    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerStarted","Data":"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"}
Oct 30 20:53:08.071915 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:08.071633    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerStarted","Data":"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"}
Oct 30 20:53:08.204038 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:08.203992    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podStartSLOduration=5.916767567 podStartE2EDuration="9.203979847s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.28721228s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:53:08.200469038 +0000 UTC m=+963.156483814" watchObservedRunningTime="2026-10-30 20:53:08.203979847 +0000 UTC m=+963.159994601"
Oct 30 20:53:12.157056 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:12.157006    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:15.672313 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:53:15.672271    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:53:17.161181 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:17.161156    5937 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:17.163143 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:17.163128    5937 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:18.122343 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:18.122316    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:44.072912 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.072880    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"]
Oct 30 20:53:44.073376 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.073052    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299" podUID="c4687532-280b-4005-9197-2205a3adf8b2" containerName="thanos-querier" containerID="cri-o://affabbd71eec1a47924e08d0f1614a4df604dc2b61a744c61c88fb91fbee389a" gracePeriod=30
Oct 30 20:53:44.228937 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.228904    5937 generic.go:356] "Generic (PLEG): container finished" podID="c4687532-280b-4005-9197-2205a3adf8b2" containerID="affabbd71eec1a47924e08d0f1614a4df604dc2b61a744c61c88fb91fbee389a" exitCode=0
Oct 30 20:53:44.228937 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.228940    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299" event={"ID":"c4687532-280b-4005-9197-2205a3adf8b2","Type":"ContainerDied","Data":"affabbd71eec1a47924e08d0f1614a4df604dc2b61a744c61c88fb91fbee389a"}
Oct 30 20:53:44.315929 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.315902    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"
Oct 30 20:53:44.343880 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.343817    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c4687532-280b-4005-9197-2205a3adf8b2-kube-api-access-gn5s4\" (UniqueName: \"kubernetes.io/projected/c4687532-280b-4005-9197-2205a3adf8b2-kube-api-access-gn5s4\") pod \"c4687532-280b-4005-9197-2205a3adf8b2\" (UID: \"c4687532-280b-4005-9197-2205a3adf8b2\") "
Oct 30 20:53:44.346058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.346026    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4687532-280b-4005-9197-2205a3adf8b2-kube-api-access-gn5s4" pod "c4687532-280b-4005-9197-2205a3adf8b2" (UID: "c4687532-280b-4005-9197-2205a3adf8b2"). InnerVolumeSpecName "kube-api-access-gn5s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:44.404066 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.404036    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 20:53:44.404374 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.404344    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="prometheus" containerID="cri-o://663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff" gracePeriod=600
Oct 30 20:53:44.404374 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.404359    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="config-reloader" containerID="cri-o://8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260" gracePeriod=600
Oct 30 20:53:44.404568 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.404396    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="thanos-sidecar" containerID="cri-o://e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996" gracePeriod=600
Oct 30 20:53:44.445225 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:44.445195    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn5s4\" (UniqueName: \"kubernetes.io/projected/c4687532-280b-4005-9197-2205a3adf8b2-kube-api-access-gn5s4\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.160201 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.160177    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:45.236331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.236299    5937 generic.go:356] "Generic (PLEG): container finished" podID="fc91b113-6937-416a-8827-f4a0909241f7" containerID="e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996" exitCode=0
Oct 30 20:53:45.236331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.236324    5937 generic.go:356] "Generic (PLEG): container finished" podID="fc91b113-6937-416a-8827-f4a0909241f7" containerID="8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260" exitCode=0
Oct 30 20:53:45.236331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.236330    5937 generic.go:356] "Generic (PLEG): container finished" podID="fc91b113-6937-416a-8827-f4a0909241f7" containerID="663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff" exitCode=0
Oct 30 20:53:45.236650 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.236381    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"
Oct 30 20:53:45.236650 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.236385    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerDied","Data":"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"}
Oct 30 20:53:45.236650 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.236458    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerDied","Data":"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"}
Oct 30 20:53:45.236650 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.236494    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerDied","Data":"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"}
Oct 30 20:53:45.236650 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.236513    5937 scope.go:122] "RemoveContainer" containerID="e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"
Oct 30 20:53:45.236650 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.236520    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-0" event={"ID":"fc91b113-6937-416a-8827-f4a0909241f7","Type":"ContainerDied","Data":"35014ce05cb096e0914a4d36b4d37df971df384b1f16edb44f5eedeed791c718"}
Oct 30 20:53:45.237802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.237780    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299" event={"ID":"c4687532-280b-4005-9197-2205a3adf8b2","Type":"ContainerDied","Data":"c693066ac0516b8b59adc3ccf33f859926c5f6783e4845f1b23a0ca44af3898b"}
Oct 30 20:53:45.237802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.237802    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"
Oct 30 20:53:45.244731 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.244714    5937 scope.go:122] "RemoveContainer" containerID="8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.251962    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc91b113-6937-416a-8827-f4a0909241f7-config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc91b113-6937-416a-8827-f4a0909241f7-config-out\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252010    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-tls-assets\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-tls-assets\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252049    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-thanos-prometheus-http-client-file\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252098    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252139    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-secret-prometheus-web-tls-ca\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252165    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-config\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252249    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252280    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-kube-api-access-rtwh5\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-kube-api-access-rtwh5\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252311    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252353    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252382    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252416    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.252453    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config\") pod \"fc91b113-6937-416a-8827-f4a0909241f7\" (UID: \"fc91b113-6937-416a-8827-f4a0909241f7\") "
Oct 30 20:53:45.255951 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.255160    5937 scope.go:122] "RemoveContainer" containerID="663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"
Oct 30 20:53:45.255951 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.255465    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-2" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:45.255951 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.255934    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-1" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:45.256112 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.256038    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-0" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:45.258981 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.258877    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-secret-prometheus-web-tls-ca" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:45.258981 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.258956    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-config" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:45.258981 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.258951    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc91b113-6937-416a-8827-f4a0909241f7-config-out" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:45.259130 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.259006    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-tls-assets" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:45.259960 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.259917    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:45.260202 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.260174    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-thanos-prometheus-http-client-file" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:45.260824 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.260750    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-kube-api-access-rtwh5" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "kube-api-access-rtwh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:45.260960 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.260933    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:45.262902 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.262879    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 20:53:45.270213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.270166    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config" pod "fc91b113-6937-416a-8827-f4a0909241f7" (UID: "fc91b113-6937-416a-8827-f4a0909241f7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:45.283330 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.283312    5937 scope.go:122] "RemoveContainer" containerID="0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"
Oct 30 20:53:45.291311 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.291285    5937 scope.go:122] "RemoveContainer" containerID="e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"
Oct 30 20:53:45.291618 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:53:45.291594    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996\": container with ID starting with e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996 not found: ID does not exist" containerID="e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"
Oct 30 20:53:45.291678 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.291630    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"} err="failed to get container status \"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996\": rpc error: code = NotFound desc = could not find container \"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996\": container with ID starting with e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996 not found: ID does not exist"
Oct 30 20:53:45.291678 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.291650    5937 scope.go:122] "RemoveContainer" containerID="8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"
Oct 30 20:53:45.291870 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:53:45.291852    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260\": container with ID starting with 8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260 not found: ID does not exist" containerID="8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"
Oct 30 20:53:45.291938 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.291880    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"} err="failed to get container status \"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260\": rpc error: code = NotFound desc = could not find container \"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260\": container with ID starting with 8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260 not found: ID does not exist"
Oct 30 20:53:45.291938 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.291904    5937 scope.go:122] "RemoveContainer" containerID="663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"
Oct 30 20:53:45.292122 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:53:45.292105    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff\": container with ID starting with 663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff not found: ID does not exist" containerID="663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"
Oct 30 20:53:45.292194 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292128    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"} err="failed to get container status \"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff\": rpc error: code = NotFound desc = could not find container \"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff\": container with ID starting with 663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff not found: ID does not exist"
Oct 30 20:53:45.292194 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292148    5937 scope.go:122] "RemoveContainer" containerID="0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"
Oct 30 20:53:45.292355 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:53:45.292340    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f\": container with ID starting with 0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f not found: ID does not exist" containerID="0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"
Oct 30 20:53:45.292391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292360    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"} err="failed to get container status \"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f\": rpc error: code = NotFound desc = could not find container \"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f\": container with ID starting with 0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f not found: ID does not exist"
Oct 30 20:53:45.292391 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292373    5937 scope.go:122] "RemoveContainer" containerID="e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"
Oct 30 20:53:45.292602 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292523    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"} err="failed to get container status \"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996\": rpc error: code = NotFound desc = could not find container \"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996\": container with ID starting with e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996 not found: ID does not exist"
Oct 30 20:53:45.292602 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292556    5937 scope.go:122] "RemoveContainer" containerID="8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"
Oct 30 20:53:45.292759 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292742    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"} err="failed to get container status \"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260\": rpc error: code = NotFound desc = could not find container \"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260\": container with ID starting with 8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260 not found: ID does not exist"
Oct 30 20:53:45.292832 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292761    5937 scope.go:122] "RemoveContainer" containerID="663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"
Oct 30 20:53:45.292963 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292946    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"} err="failed to get container status \"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff\": rpc error: code = NotFound desc = could not find container \"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff\": container with ID starting with 663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff not found: ID does not exist"
Oct 30 20:53:45.293012 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.292963    5937 scope.go:122] "RemoveContainer" containerID="0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"
Oct 30 20:53:45.293188 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.293172    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"} err="failed to get container status \"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f\": rpc error: code = NotFound desc = could not find container \"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f\": container with ID starting with 0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f not found: ID does not exist"
Oct 30 20:53:45.293234 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.293189    5937 scope.go:122] "RemoveContainer" containerID="e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"
Oct 30 20:53:45.293378 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.293359    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996"} err="failed to get container status \"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996\": rpc error: code = NotFound desc = could not find container \"e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996\": container with ID starting with e2952d41e6a76ebea98ad1f5b2c97b285ead7fa65778ca829d99b71cde6a1996 not found: ID does not exist"
Oct 30 20:53:45.293421 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.293381    5937 scope.go:122] "RemoveContainer" containerID="8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"
Oct 30 20:53:45.293607 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.293590    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260"} err="failed to get container status \"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260\": rpc error: code = NotFound desc = could not find container \"8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260\": container with ID starting with 8510bd235a61e3ff3b2aa70d40b516c0ec9c1d3daafe1232050b2d9d85769260 not found: ID does not exist"
Oct 30 20:53:45.293660 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.293607    5937 scope.go:122] "RemoveContainer" containerID="663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"
Oct 30 20:53:45.293839 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.293822    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff"} err="failed to get container status \"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff\": rpc error: code = NotFound desc = could not find container \"663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff\": container with ID starting with 663fd4f4bb400ad535229ac9dc1322838f2ed4bb6b00972fca9d5af6a23914ff not found: ID does not exist"
Oct 30 20:53:45.293882 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.293839    5937 scope.go:122] "RemoveContainer" containerID="0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"
Oct 30 20:53:45.294061 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.294040    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f"} err="failed to get container status \"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f\": rpc error: code = NotFound desc = could not find container \"0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f\": container with ID starting with 0d73da06f887033020ab75232952f7a9bb3197ce08a0005c486fd2533ee0f98f not found: ID does not exist"
Oct 30 20:53:45.294061 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.294060    5937 scope.go:122] "RemoveContainer" containerID="affabbd71eec1a47924e08d0f1614a4df604dc2b61a744c61c88fb91fbee389a"
Oct 30 20:53:45.353424 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353401    5937 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc91b113-6937-416a-8827-f4a0909241f7-config-out\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353424 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353423    5937 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-tls-assets\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353436    5937 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353447    5937 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353456    5937 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-secret-prometheus-web-tls-ca\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353466    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353492    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353502    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtwh5\" (UniqueName: \"kubernetes.io/projected/fc91b113-6937-416a-8827-f4a0909241f7-kube-api-access-rtwh5\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353512    5937 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353522    5937 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353531    5937 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353562    5937 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc91b113-6937-416a-8827-f4a0909241f7-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.353590 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.353573    5937 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc91b113-6937-416a-8827-f4a0909241f7-web-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:45.371812 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.371795    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-e73afc79-aa37-49a0-8744-633c03cad1f4" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:53:45.454549 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.454507    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-e73afc79-aa37-49a0-8744-633c03cad1f4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0a155a55c1ce0e65b\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-ba332f9bf0d1b4a6d9e8dc7e3ea187b96ae03f9eff9e13fdbc24ad7be374242c\""
Oct 30 20:53:45.519952 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.519922    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"]
Oct 30 20:53:45.522660 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.522595    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vn299"]
Oct 30 20:53:45.670929 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.670898    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 20:53:45.672727 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:53:45.672691    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:53:45.680458 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:45.680435    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-0"]
Oct 30 20:53:46.943253 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:46.943225    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"]
Oct 30 20:53:46.943706 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:46.943418    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk" podUID="81b5d44f-d306-429c-aa32-b87440e9a28b" containerName="ta-container" containerID="cri-o://4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e" gracePeriod=30
Oct 30 20:53:47.161706 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.161675    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c4687532-280b-4005-9197-2205a3adf8b2" path="/var/lib/kubelet/pods/c4687532-280b-4005-9197-2205a3adf8b2/volumes"
Oct 30 20:53:47.162157 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.162143    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc91b113-6937-416a-8827-f4a0909241f7" path="/var/lib/kubelet/pods/fc91b113-6937-416a-8827-f4a0909241f7/volumes"
Oct 30 20:53:47.189979 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.189960    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:53:47.248464 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.248434    5937 generic.go:356] "Generic (PLEG): container finished" podID="81b5d44f-d306-429c-aa32-b87440e9a28b" containerID="4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e" exitCode=0
Oct 30 20:53:47.248642 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.248468    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk" event={"ID":"81b5d44f-d306-429c-aa32-b87440e9a28b","Type":"ContainerDied","Data":"4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e"}
Oct 30 20:53:47.248642 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.248486    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"
Oct 30 20:53:47.248642 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.248510    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk" event={"ID":"81b5d44f-d306-429c-aa32-b87440e9a28b","Type":"ContainerDied","Data":"1d0779ce375d101b6f6d6df18efac8f95d45f32f0f1598255550ddc52ecae90b"}
Oct 30 20:53:47.248642 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.248531    5937 scope.go:122] "RemoveContainer" containerID="4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e"
Oct 30 20:53:47.257007 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.256990    5937 scope.go:122] "RemoveContainer" containerID="4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e"
Oct 30 20:53:47.257371 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:53:47.257348    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e\": container with ID starting with 4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e not found: ID does not exist" containerID="4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e"
Oct 30 20:53:47.257452 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.257378    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e"} err="failed to get container status \"4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e\": rpc error: code = NotFound desc = could not find container \"4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e\": container with ID starting with 4d2855db4fcc5bdc3922a53ad10aeea7ef19664c59a37180cf4a1d493e19066e not found: ID does not exist"
Oct 30 20:53:47.268765 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.268740    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81b5d44f-d306-429c-aa32-b87440e9a28b-kube-api-access-94zk6\" (UniqueName: \"kubernetes.io/projected/81b5d44f-d306-429c-aa32-b87440e9a28b-kube-api-access-94zk6\") pod \"81b5d44f-d306-429c-aa32-b87440e9a28b\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") "
Oct 30 20:53:47.268858 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.268826    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81b5d44f-d306-429c-aa32-b87440e9a28b-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81b5d44f-d306-429c-aa32-b87440e9a28b-data-science-collector-ta-server-cert\") pod \"81b5d44f-d306-429c-aa32-b87440e9a28b\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") "
Oct 30 20:53:47.268858 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.268850    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81b5d44f-d306-429c-aa32-b87440e9a28b-ta-internal\" (UniqueName: \"kubernetes.io/configmap/81b5d44f-d306-429c-aa32-b87440e9a28b-ta-internal\") pod \"81b5d44f-d306-429c-aa32-b87440e9a28b\" (UID: \"81b5d44f-d306-429c-aa32-b87440e9a28b\") "
Oct 30 20:53:47.269282 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.269256    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81b5d44f-d306-429c-aa32-b87440e9a28b-ta-internal" pod "81b5d44f-d306-429c-aa32-b87440e9a28b" (UID: "81b5d44f-d306-429c-aa32-b87440e9a28b"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:47.273256 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.273084    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b5d44f-d306-429c-aa32-b87440e9a28b-kube-api-access-94zk6" pod "81b5d44f-d306-429c-aa32-b87440e9a28b" (UID: "81b5d44f-d306-429c-aa32-b87440e9a28b"). InnerVolumeSpecName "kube-api-access-94zk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:47.275675 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.275651    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b5d44f-d306-429c-aa32-b87440e9a28b-data-science-collector-ta-server-cert" pod "81b5d44f-d306-429c-aa32-b87440e9a28b" (UID: "81b5d44f-d306-429c-aa32-b87440e9a28b"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:53:47.285797 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.285772    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:53:47.286011 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.285987    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="f76666c6-88a7-400d-9175-9bab948c0f91" containerName="perses" containerID="cri-o://0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba" gracePeriod=30
Oct 30 20:53:47.369859 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.369830    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/81b5d44f-d306-429c-aa32-b87440e9a28b-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.369859 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.369857    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94zk6\" (UniqueName: \"kubernetes.io/projected/81b5d44f-d306-429c-aa32-b87440e9a28b-kube-api-access-94zk6\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.370049 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.369870    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/81b5d44f-d306-429c-aa32-b87440e9a28b-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.520444 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.520420    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:53:47.572289 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.572261    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"f76666c6-88a7-400d-9175-9bab948c0f91\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") "
Oct 30 20:53:47.572441 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.572299    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f76666c6-88a7-400d-9175-9bab948c0f91-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76666c6-88a7-400d-9175-9bab948c0f91-plugins\") pod \"f76666c6-88a7-400d-9175-9bab948c0f91\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") "
Oct 30 20:53:47.572441 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.572342    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f76666c6-88a7-400d-9175-9bab948c0f91-config\" (UniqueName: \"kubernetes.io/configmap/f76666c6-88a7-400d-9175-9bab948c0f91-config\") pod \"f76666c6-88a7-400d-9175-9bab948c0f91\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") "
Oct 30 20:53:47.572441 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.572376    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f76666c6-88a7-400d-9175-9bab948c0f91-kube-api-access-dxbpx\" (UniqueName: \"kubernetes.io/projected/f76666c6-88a7-400d-9175-9bab948c0f91-kube-api-access-dxbpx\") pod \"f76666c6-88a7-400d-9175-9bab948c0f91\" (UID: \"f76666c6-88a7-400d-9175-9bab948c0f91\") "
Oct 30 20:53:47.572794 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.572754    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f76666c6-88a7-400d-9175-9bab948c0f91-config" pod "f76666c6-88a7-400d-9175-9bab948c0f91" (UID: "f76666c6-88a7-400d-9175-9bab948c0f91"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:53:47.574828 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.574803    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f76666c6-88a7-400d-9175-9bab948c0f91-kube-api-access-dxbpx" pod "f76666c6-88a7-400d-9175-9bab948c0f91" (UID: "f76666c6-88a7-400d-9175-9bab948c0f91"). InnerVolumeSpecName "kube-api-access-dxbpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:53:47.575313 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.575295    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "f76666c6-88a7-400d-9175-9bab948c0f91" (UID: "f76666c6-88a7-400d-9175-9bab948c0f91"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 20:53:47.673330 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.673293    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 20:53:47.673556 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.673353    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f76666c6-88a7-400d-9175-9bab948c0f91-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.673556 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.673371    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxbpx\" (UniqueName: \"kubernetes.io/projected/f76666c6-88a7-400d-9175-9bab948c0f91-kube-api-access-dxbpx\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:47.687201 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.687178    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 20:53:47.730529 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.730496    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f76666c6-88a7-400d-9175-9bab948c0f91-plugins" pod "f76666c6-88a7-400d-9175-9bab948c0f91" (UID: "f76666c6-88a7-400d-9175-9bab948c0f91"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 20:53:47.752907 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.752878    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"]
Oct 30 20:53:47.757493 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.757473    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-55b57b5774-zvhlk"]
Oct 30 20:53:47.774168 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.774127    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 20:53:47.774168 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:47.774146    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f76666c6-88a7-400d-9175-9bab948c0f91-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:53:48.255421 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:48.255388    5937 generic.go:356] "Generic (PLEG): container finished" podID="f76666c6-88a7-400d-9175-9bab948c0f91" containerID="0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba" exitCode=0
Oct 30 20:53:48.255935 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:48.255437    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f76666c6-88a7-400d-9175-9bab948c0f91","Type":"ContainerDied","Data":"0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba"}
Oct 30 20:53:48.255935 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:48.255450    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:53:48.255935 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:48.255474    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f76666c6-88a7-400d-9175-9bab948c0f91","Type":"ContainerDied","Data":"95b6fe08d000af325c86f145d5b916026760dc332736d64b60ba5843127af1b6"}
Oct 30 20:53:48.255935 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:48.255496    5937 scope.go:122] "RemoveContainer" containerID="0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba"
Oct 30 20:53:48.264981 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:48.264957    5937 scope.go:122] "RemoveContainer" containerID="0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba"
Oct 30 20:53:48.265267 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:53:48.265240    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba\": container with ID starting with 0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba not found: ID does not exist" containerID="0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba"
Oct 30 20:53:48.265372 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:48.265276    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba"} err="failed to get container status \"0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba\": rpc error: code = NotFound desc = could not find container \"0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba\": container with ID starting with 0f0fbb90a099932564a03df5913f90abbc818a664396f1e3df9579cbcdc546ba not found: ID does not exist"
Oct 30 20:53:48.422486 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:48.422454    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:53:48.426448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:48.426383    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:53:49.160256 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:49.160224    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81b5d44f-d306-429c-aa32-b87440e9a28b" path="/var/lib/kubelet/pods/81b5d44f-d306-429c-aa32-b87440e9a28b/volumes"
Oct 30 20:53:49.160646 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:53:49.160632    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f76666c6-88a7-400d-9175-9bab948c0f91" path="/var/lib/kubelet/pods/f76666c6-88a7-400d-9175-9bab948c0f91/volumes"
Oct 30 20:54:05.719413 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719383    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"]
Oct 30 20:54:05.719818 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719770    5937 cpu_manager.go:414] "containerMap: removing container" podUID="c4687532-280b-4005-9197-2205a3adf8b2" containerName="thanos-querier"
Oct 30 20:54:05.719818 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719783    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c4687532-280b-4005-9197-2205a3adf8b2" containerName="thanos-querier"
Oct 30 20:54:05.719818 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719800    5937 cpu_manager.go:414] "containerMap: removing container" podUID="4f04badb-2cba-495e-8725-b2f180ed5340" containerName="thanos-querier"
Oct 30 20:54:05.719818 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719806    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f04badb-2cba-495e-8725-b2f180ed5340" containerName="thanos-querier"
Oct 30 20:54:05.719818 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719816    5937 cpu_manager.go:414] "containerMap: removing container" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="thanos-sidecar"
Oct 30 20:54:05.719818 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719821    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="thanos-sidecar"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719833    5937 cpu_manager.go:414] "containerMap: removing container" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="init-config-reloader"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719837    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="init-config-reloader"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719843    5937 cpu_manager.go:414] "containerMap: removing container" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="config-reloader"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719847    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="config-reloader"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719858    5937 cpu_manager.go:414] "containerMap: removing container" podUID="81b5d44f-d306-429c-aa32-b87440e9a28b" containerName="ta-container"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719866    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81b5d44f-d306-429c-aa32-b87440e9a28b" containerName="ta-container"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719874    5937 cpu_manager.go:414] "containerMap: removing container" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="prometheus"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719879    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="prometheus"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719886    5937 cpu_manager.go:414] "containerMap: removing container" podUID="f76666c6-88a7-400d-9175-9bab948c0f91" containerName="perses"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719890    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f76666c6-88a7-400d-9175-9bab948c0f91" containerName="perses"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719947    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="c4687532-280b-4005-9197-2205a3adf8b2" containerName="thanos-querier"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719956    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f04badb-2cba-495e-8725-b2f180ed5340" containerName="thanos-querier"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719963    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="thanos-sidecar"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719969    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="config-reloader"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719975    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="81b5d44f-d306-429c-aa32-b87440e9a28b" containerName="ta-container"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719979    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc91b113-6937-416a-8827-f4a0909241f7" containerName="prometheus"
Oct 30 20:54:05.720058 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.719986    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="f76666c6-88a7-400d-9175-9bab948c0f91" containerName="perses"
Oct 30 20:54:05.725031 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.725011    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"
Oct 30 20:54:05.781393 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.781369    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 20:54:05.826254 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.826227    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdhtb\" (UniqueName: \"kubernetes.io/projected/5424a341-4a73-49f5-9f06-b6fc4d410d5b-kube-api-access-pdhtb\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j\" (UID: \"5424a341-4a73-49f5-9f06-b6fc4d410d5b\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"
Oct 30 20:54:05.832090 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.832071    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 20:54:05.832205 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.832183    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 20:54:05.832813 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.832796    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"]
Oct 30 20:54:05.927557 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.927504    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdhtb\" (UniqueName: \"kubernetes.io/projected/5424a341-4a73-49f5-9f06-b6fc4d410d5b-kube-api-access-pdhtb\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j\" (UID: \"5424a341-4a73-49f5-9f06-b6fc4d410d5b\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"
Oct 30 20:54:05.990187 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:05.990125    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdhtb\" (UniqueName: \"kubernetes.io/projected/5424a341-4a73-49f5-9f06-b6fc4d410d5b-kube-api-access-pdhtb\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j\" (UID: \"5424a341-4a73-49f5-9f06-b6fc4d410d5b\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"
Oct 30 20:54:06.036107 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:06.036080    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"
Oct 30 20:54:06.412420 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:06.412350    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"]
Oct 30 20:54:06.415550 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:54:06.415504    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5424a341_4a73_49f5_9f06_b6fc4d410d5b.slice/crio-a6136c66756bde01abcc0565d0e2b6db196b98f1c9077fede99d6757dae463ba WatchSource:0}: Error finding container a6136c66756bde01abcc0565d0e2b6db196b98f1c9077fede99d6757dae463ba: Status 404 returned error can't find the container with id a6136c66756bde01abcc0565d0e2b6db196b98f1c9077fede99d6757dae463ba
Oct 30 20:54:07.333252 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:07.333211    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j" event={"ID":"5424a341-4a73-49f5-9f06-b6fc4d410d5b","Type":"ContainerStarted","Data":"750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba"}
Oct 30 20:54:07.333680 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:07.333261    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j" event={"ID":"5424a341-4a73-49f5-9f06-b6fc4d410d5b","Type":"ContainerStarted","Data":"a6136c66756bde01abcc0565d0e2b6db196b98f1c9077fede99d6757dae463ba"}
Oct 30 20:54:07.450577 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:07.450496    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j" podStartSLOduration=2.450477588 podStartE2EDuration="2.450477588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:07.450159578 +0000 UTC m=+1022.406174354" watchObservedRunningTime="2026-10-30 20:54:07.450477588 +0000 UTC m=+1022.406492369"
Oct 30 20:54:09.058202 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.058172    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:54:09.061476 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.061460    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.120063 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.120037    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:54:09.165869 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.165848    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 20:54:09.256144 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.256117    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jk2w\" (UniqueName: \"kubernetes.io/projected/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-kube-api-access-6jk2w\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.256313 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.256291    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-plugins\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.256408 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.256387    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-config\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.264694 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.264671    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"]
Oct 30 20:54:09.267829 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.267815    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.326679 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.326628    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 20:54:09.326762 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.326688    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 20:54:09.326808 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.326760    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-ltdzb\""
Oct 30 20:54:09.333708 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.333675    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"]
Oct 30 20:54:09.357331 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.357307    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-74b986f996-qw9c9\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.357437 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.357359    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-plugins\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.357437 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.357379    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-ta-internal\") pod \"data-science-collector-targetallocator-74b986f996-qw9c9\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.357437 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.357399    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-config\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.357587 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.357479    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jk2w\" (UniqueName: \"kubernetes.io/projected/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-kube-api-access-6jk2w\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.357587 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.357550    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5t59\" (UniqueName: \"kubernetes.io/projected/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-kube-api-access-r5t59\") pod \"data-science-collector-targetallocator-74b986f996-qw9c9\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.357892 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.357875    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-plugins\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.358017 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.357999    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-config\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.429596 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.429509    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jk2w\" (UniqueName: \"kubernetes.io/projected/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-kube-api-access-6jk2w\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:09.458568 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.458524    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-ta-internal\") pod \"data-science-collector-targetallocator-74b986f996-qw9c9\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.458686 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.458601    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5t59\" (UniqueName: \"kubernetes.io/projected/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-kube-api-access-r5t59\") pod \"data-science-collector-targetallocator-74b986f996-qw9c9\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.458686 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.458663    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-74b986f996-qw9c9\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.459226 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.459209    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-ta-internal\") pod \"data-science-collector-targetallocator-74b986f996-qw9c9\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.460943 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.460926    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-74b986f996-qw9c9\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.532379 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.532350    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5t59\" (UniqueName: \"kubernetes.io/projected/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-kube-api-access-r5t59\") pod \"data-science-collector-targetallocator-74b986f996-qw9c9\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.579380 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.579325    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:09.958854 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.958800    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"]
Oct 30 20:54:09.961899 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:54:09.961867    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ae782ac_6eda_4a8e_bb95_ddf6a66832a3.slice/crio-6cc7b2e828118dec614473140d193d726b254709e703781bec6501d0c3a4e2c9 WatchSource:0}: Error finding container 6cc7b2e828118dec614473140d193d726b254709e703781bec6501d0c3a4e2c9: Status 404 returned error can't find the container with id 6cc7b2e828118dec614473140d193d726b254709e703781bec6501d0c3a4e2c9
Oct 30 20:54:09.964357 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.964327    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:54:09.964454 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:09.964384    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:54:10.346333 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:10.346248    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9" event={"ID":"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3","Type":"ContainerStarted","Data":"ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e"}
Oct 30 20:54:10.346333 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:10.346293    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9" event={"ID":"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3","Type":"ContainerStarted","Data":"6cc7b2e828118dec614473140d193d726b254709e703781bec6501d0c3a4e2c9"}
Oct 30 20:54:10.346806 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:10.346431    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:10.347729 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:10.347705    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9" podUID="4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.36:8080/readyz\": dial tcp 10.134.0.36:8080: connect: connection refused"
Oct 30 20:54:10.493053 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:10.492999    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9" podStartSLOduration=1.492985859 podStartE2EDuration="1.492985859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:10.49258829 +0000 UTC m=+1025.448603067" watchObservedRunningTime="2026-10-30 20:54:10.492985859 +0000 UTC m=+1025.449000635"
Oct 30 20:54:11.351584 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:11.351530    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:54:11.473779 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:11.473749    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:11.580628 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:11.580597    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:11.675869 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:11.675805    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:11.675997 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:11.675930    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:11.729116 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:11.729088    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:11.865804 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:11.865776    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:11.938142 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:11.938087    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:12.073477 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:12.073446    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:12.445230 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:12.445204    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 20:54:12.447716 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:54:12.447690    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod969f6eeb_03ac_49e9_b3e7_e6dbc4e0f115.slice/crio-05564e18a0598545dc86660fca6652104e00a9b853f519b8fe1d2be3c266f43d WatchSource:0}: Error finding container 05564e18a0598545dc86660fca6652104e00a9b853f519b8fe1d2be3c266f43d: Status 404 returned error can't find the container with id 05564e18a0598545dc86660fca6652104e00a9b853f519b8fe1d2be3c266f43d
Oct 30 20:54:13.361133 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:13.361092    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115","Type":"ContainerStarted","Data":"de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655"}
Oct 30 20:54:13.361340 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:13.361149    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115","Type":"ContainerStarted","Data":"05564e18a0598545dc86660fca6652104e00a9b853f519b8fe1d2be3c266f43d"}
Oct 30 20:54:13.361393 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:13.361336    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:13.484723 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:13.484664    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=4.4846464 podStartE2EDuration="4.4846464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:13.483892411 +0000 UTC m=+1028.439907187" watchObservedRunningTime="2026-10-30 20:54:13.4846464 +0000 UTC m=+1028.440661180"
Oct 30 20:54:15.670883 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:54:15.670848    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:54:21.072090 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:21.072055    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"]
Oct 30 20:54:21.075276 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:21.075256    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"
Oct 30 20:54:21.134429 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:21.134397    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"]
Oct 30 20:54:21.158799 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:21.158770    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t4hr\" (UniqueName: \"kubernetes.io/projected/23a42850-66f7-48db-a34b-fae2d39e28e0-kube-api-access-2t4hr\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx\" (UID: \"23a42850-66f7-48db-a34b-fae2d39e28e0\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"
Oct 30 20:54:21.259902 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:21.259865    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t4hr\" (UniqueName: \"kubernetes.io/projected/23a42850-66f7-48db-a34b-fae2d39e28e0-kube-api-access-2t4hr\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx\" (UID: \"23a42850-66f7-48db-a34b-fae2d39e28e0\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"
Oct 30 20:54:21.322887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:21.322816    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t4hr\" (UniqueName: \"kubernetes.io/projected/23a42850-66f7-48db-a34b-fae2d39e28e0-kube-api-access-2t4hr\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx\" (UID: \"23a42850-66f7-48db-a34b-fae2d39e28e0\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"
Oct 30 20:54:21.386558 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:21.386513    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"
Oct 30 20:54:21.766113 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:21.766080    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"]
Oct 30 20:54:21.769552 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:54:21.769502    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23a42850_66f7_48db_a34b_fae2d39e28e0.slice/crio-dd59984eab2ae9d9ac2c916454834a60ce7b1fee509483d3f34760e1760cb92f WatchSource:0}: Error finding container dd59984eab2ae9d9ac2c916454834a60ce7b1fee509483d3f34760e1760cb92f: Status 404 returned error can't find the container with id dd59984eab2ae9d9ac2c916454834a60ce7b1fee509483d3f34760e1760cb92f
Oct 30 20:54:22.407026 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.406991    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx" event={"ID":"23a42850-66f7-48db-a34b-fae2d39e28e0","Type":"ContainerStarted","Data":"3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3"}
Oct 30 20:54:22.407510 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.407041    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx" event={"ID":"23a42850-66f7-48db-a34b-fae2d39e28e0","Type":"ContainerStarted","Data":"dd59984eab2ae9d9ac2c916454834a60ce7b1fee509483d3f34760e1760cb92f"}
Oct 30 20:54:22.524205 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.524154    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx" podStartSLOduration=1.524139523 podStartE2EDuration="1.524139523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:54:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:22.523601363 +0000 UTC m=+1037.479616141" watchObservedRunningTime="2026-10-30 20:54:22.524139523 +0000 UTC m=+1037.480154299"
Oct 30 20:54:22.555607 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.555577    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"]
Oct 30 20:54:22.555811 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.555785    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j" podUID="5424a341-4a73-49f5-9f06-b6fc4d410d5b" containerName="thanos-querier" containerID="cri-o://750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba" gracePeriod=30
Oct 30 20:54:22.770444 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.770415    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 20:54:22.778613 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.778587    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.822645 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.822620    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"
Oct 30 20:54:22.848119 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.848088    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 20:54:22.885682 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.885647    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-2\""
Oct 30 20:54:22.885682 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.885652    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-1\""
Oct 30 20:54:22.886514 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.885813    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-rulefiles-0\""
Oct 30 20:54:22.886514 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.885843    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-thanos-prometheus-http-client-file\""
Oct 30 20:54:22.886514 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.885898    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack\""
Oct 30 20:54:22.886514 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.885937    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-web-config\""
Oct 30 20:54:22.886514 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.885940    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-monitoringstack-prometheus-dockercfg-x6vfm\""
Oct 30 20:54:22.886514 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.885997    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-data-science-monitoringstack-tls-assets-0\""
Oct 30 20:54:22.886514 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.886002    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-operated-tls\""
Oct 30 20:54:22.886514 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.886020    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"prometheus-web-tls-ca\""
Oct 30 20:54:22.974388 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.974359    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5424a341-4a73-49f5-9f06-b6fc4d410d5b-kube-api-access-pdhtb\" (UniqueName: \"kubernetes.io/projected/5424a341-4a73-49f5-9f06-b6fc4d410d5b-kube-api-access-pdhtb\") pod \"5424a341-4a73-49f5-9f06-b6fc4d410d5b\" (UID: \"5424a341-4a73-49f5-9f06-b6fc4d410d5b\") "
Oct 30 20:54:22.974607 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.974511    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.974607 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.974567    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpjt\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-kube-api-access-2hpjt\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.974738 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.974663    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.974794 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.974747    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config-out\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.974837 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.974798    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.974941 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.974921    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.975034 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.974994    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.975096 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.975037    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.975158 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.975113    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-tls-assets\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.975214 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.975166    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.975214 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.975201    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.975309 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.975227    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:22.976661 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:22.976644    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5424a341-4a73-49f5-9f06-b6fc4d410d5b-kube-api-access-pdhtb" pod "5424a341-4a73-49f5-9f06-b6fc4d410d5b" (UID: "5424a341-4a73-49f5-9f06-b6fc4d410d5b"). InnerVolumeSpecName "kube-api-access-pdhtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:54:23.076512 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076472    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpjt\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-kube-api-access-2hpjt\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.076512 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076513    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.076741 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076573    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config-out\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.076741 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076617    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.076741 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076669    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.076741 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076706    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.076939 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076830    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.076939 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076901    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-tls-assets\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.076939 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076937    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.077157 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076965    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.077157 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.076992    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.077157 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.077039    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.077157 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.077103    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdhtb\" (UniqueName: \"kubernetes.io/projected/5424a341-4a73-49f5-9f06-b6fc4d410d5b-kube-api-access-pdhtb\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:54:23.077665 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.077597    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.078697 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.078574    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.078697 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.078634    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.080598 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.080293    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.080598 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.080371    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.080598 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.080496    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-tls-assets\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.080598 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.080552    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-thanos-prometheus-http-client-file\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.080598 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.080571    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config-out\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.080892 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.080787    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-secret-prometheus-web-tls-ca\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.081129 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.081108    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.081558 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.081523    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.139617 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.139585    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpjt\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-kube-api-access-2hpjt\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:23.412831 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.412750    5937 generic.go:356] "Generic (PLEG): container finished" podID="5424a341-4a73-49f5-9f06-b6fc4d410d5b" containerID="750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba" exitCode=0
Oct 30 20:54:23.412831 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.412793    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"
Oct 30 20:54:23.413323 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.412829    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j" event={"ID":"5424a341-4a73-49f5-9f06-b6fc4d410d5b","Type":"ContainerDied","Data":"750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba"}
Oct 30 20:54:23.413323 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.412870    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j" event={"ID":"5424a341-4a73-49f5-9f06-b6fc4d410d5b","Type":"ContainerDied","Data":"a6136c66756bde01abcc0565d0e2b6db196b98f1c9077fede99d6757dae463ba"}
Oct 30 20:54:23.413323 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.412887    5937 scope.go:122] "RemoveContainer" containerID="750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba"
Oct 30 20:54:23.420903 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.420884    5937 scope.go:122] "RemoveContainer" containerID="750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba"
Oct 30 20:54:23.421164 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:54:23.421147    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba\": container with ID starting with 750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba not found: ID does not exist" containerID="750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba"
Oct 30 20:54:23.421209 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.421175    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba"} err="failed to get container status \"750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba\": rpc error: code = NotFound desc = could not find container \"750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba\": container with ID starting with 750df0f7010db7b95cf22313190a911ea70e8fa10799b169925ebd1e0f3aeeba not found: ID does not exist"
Oct 30 20:54:23.580516 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.580487    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"]
Oct 30 20:54:23.584799 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:23.584773    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-cpf4j"]
Oct 30 20:54:24.368027 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:24.367950    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 20:54:25.160936 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:25.160900    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5424a341-4a73-49f5-9f06-b6fc4d410d5b" path="/var/lib/kubelet/pods/5424a341-4a73-49f5-9f06-b6fc4d410d5b/volumes"
Oct 30 20:54:31.959604 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:31.959570    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:32.066175 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:32.066139    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") device path: \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:32.161061 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:32.161014    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:32.161253 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:32.161126    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") DevicePath \"\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:32.214375 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:32.214288    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") DevicePath \"csi-b22ad38bf3b4f4bc597b0714ae5f5e5b02f893b6e7c82d1e64089686a83f348c\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:32.357663 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:32.357627    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/6dcee51846c65e61e42d030ad34b511007d41c5710f282a3474b3969662e5f6c/globalmount\"" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:32.424120 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:32.424091    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"prometheus-data-science-monitoringstack-1\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") " pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:32.698991 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:32.698893    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:33.195549 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:54:33.195507    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828cb003_2f33_4cc2_b355_b3d3cb64e05a.slice/crio-c4fc930d5826609c7831d7fe937aff70775281c0092506ee7c7a23248a6dd5bc WatchSource:0}: Error finding container c4fc930d5826609c7831d7fe937aff70775281c0092506ee7c7a23248a6dd5bc: Status 404 returned error can't find the container with id c4fc930d5826609c7831d7fe937aff70775281c0092506ee7c7a23248a6dd5bc
Oct 30 20:54:33.244932 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:33.244902    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 20:54:33.460982 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:33.460951    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerStarted","Data":"c4fc930d5826609c7831d7fe937aff70775281c0092506ee7c7a23248a6dd5bc"}
Oct 30 20:54:34.466759 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:34.466719    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerStarted","Data":"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"}
Oct 30 20:54:37.483229 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:37.483197    5937 generic.go:356] "Generic (PLEG): container finished" podID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerID="4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589" exitCode=0
Oct 30 20:54:37.483659 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:37.483278    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerDied","Data":"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"}
Oct 30 20:54:38.490133 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:38.490098    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerStarted","Data":"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"}
Oct 30 20:54:38.490498 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:38.490193    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerStarted","Data":"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"}
Oct 30 20:54:38.490498 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:38.490220    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerStarted","Data":"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"}
Oct 30 20:54:38.699724 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:38.699663    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podStartSLOduration=12.914121211 podStartE2EDuration="16.699644735s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.785523524s" isStatefulPod=true podCreationTimestamp="2026-10-30 20:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:54:38.672877789 +0000 UTC m=+1053.628892577" watchObservedRunningTime="2026-10-30 20:54:38.699644735 +0000 UTC m=+1053.655659524"
Oct 30 20:54:42.699834 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:42.699796    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:45.671323 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:54:45.671289    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:54:47.700035 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:47.700001    5937 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:47.705669 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:47.705646    5937 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:54:48.540022 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:54:48.539995    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 20:55:07.282217 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.282181    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"]
Oct 30 20:55:07.282672 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.282573    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5424a341-4a73-49f5-9f06-b6fc4d410d5b" containerName="thanos-querier"
Oct 30 20:55:07.282672 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.282587    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5424a341-4a73-49f5-9f06-b6fc4d410d5b" containerName="thanos-querier"
Oct 30 20:55:07.282672 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.282652    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5424a341-4a73-49f5-9f06-b6fc4d410d5b" containerName="thanos-querier"
Oct 30 20:55:07.287959 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.287940    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.345286 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.345254    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"]
Oct 30 20:55:07.389751 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.389719    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ca370601-3d95-4069-8859-d82102d8bc34-ta-internal\") pod \"data-science-collector-targetallocator-5c69976bcc-9bk9m\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.389929 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.389790    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp25j\" (UniqueName: \"kubernetes.io/projected/ca370601-3d95-4069-8859-d82102d8bc34-kube-api-access-qp25j\") pod \"data-science-collector-targetallocator-5c69976bcc-9bk9m\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.389929 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.389892    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ca370601-3d95-4069-8859-d82102d8bc34-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5c69976bcc-9bk9m\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.490516 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.490483    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp25j\" (UniqueName: \"kubernetes.io/projected/ca370601-3d95-4069-8859-d82102d8bc34-kube-api-access-qp25j\") pod \"data-science-collector-targetallocator-5c69976bcc-9bk9m\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.490516 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.490520    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ca370601-3d95-4069-8859-d82102d8bc34-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5c69976bcc-9bk9m\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.490766 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.490590    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ca370601-3d95-4069-8859-d82102d8bc34-ta-internal\") pod \"data-science-collector-targetallocator-5c69976bcc-9bk9m\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.491150 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.491130    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ca370601-3d95-4069-8859-d82102d8bc34-ta-internal\") pod \"data-science-collector-targetallocator-5c69976bcc-9bk9m\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.493256 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.493228    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ca370601-3d95-4069-8859-d82102d8bc34-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5c69976bcc-9bk9m\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.554491 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.554418    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp25j\" (UniqueName: \"kubernetes.io/projected/ca370601-3d95-4069-8859-d82102d8bc34-kube-api-access-qp25j\") pod \"data-science-collector-targetallocator-5c69976bcc-9bk9m\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.599069 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.599039    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:07.975802 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.975609    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"]
Oct 30 20:55:07.978475 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:55:07.978449    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca370601_3d95_4069_8859_d82102d8bc34.slice/crio-47d2bd93f5be545692b0a4505969114fe0bc676de4f29bd9da6278bcc863fe6c WatchSource:0}: Error finding container 47d2bd93f5be545692b0a4505969114fe0bc676de4f29bd9da6278bcc863fe6c: Status 404 returned error can't find the container with id 47d2bd93f5be545692b0a4505969114fe0bc676de4f29bd9da6278bcc863fe6c
Oct 30 20:55:07.983876 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.983832    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:55:07.984005 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:07.983947    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:55:08.624746 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:08.624716    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m" event={"ID":"ca370601-3d95-4069-8859-d82102d8bc34","Type":"ContainerStarted","Data":"d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070"}
Oct 30 20:55:08.625180 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:08.624756    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m" event={"ID":"ca370601-3d95-4069-8859-d82102d8bc34","Type":"ContainerStarted","Data":"47d2bd93f5be545692b0a4505969114fe0bc676de4f29bd9da6278bcc863fe6c"}
Oct 30 20:55:08.625180 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:08.624874    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:08.626099 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:08.626075    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m" podUID="ca370601-3d95-4069-8859-d82102d8bc34" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.39:8080/readyz\": dial tcp 10.134.0.39:8080: connect: connection refused"
Oct 30 20:55:08.744457 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:08.744401    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m" podStartSLOduration=1.744384452 podStartE2EDuration="1.744384452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:55:08.743399932 +0000 UTC m=+1083.699414724" watchObservedRunningTime="2026-10-30 20:55:08.744384452 +0000 UTC m=+1083.700399225"
Oct 30 20:55:09.631045 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:09.631018    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:55:09.802430 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:09.802397    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"]
Oct 30 20:55:09.802676 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:09.802633    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9" podUID="4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" containerName="ta-container" containerID="cri-o://ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e" gracePeriod=30
Oct 30 20:55:10.051003 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.050974    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:55:10.116760 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.116728    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-kube-api-access-r5t59\" (UniqueName: \"kubernetes.io/projected/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-kube-api-access-r5t59\") pod \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") "
Oct 30 20:55:10.116937 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.116778    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-ta-internal\" (UniqueName: \"kubernetes.io/configmap/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-ta-internal\") pod \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") "
Oct 30 20:55:10.116937 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.116817    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-data-science-collector-ta-server-cert\") pod \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\" (UID: \"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3\") "
Oct 30 20:55:10.117175 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.117154    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-ta-internal" pod "4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" (UID: "4ae782ac-6eda-4a8e-bb95-ddf6a66832a3"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:55:10.119065 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.119042    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-kube-api-access-r5t59" pod "4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" (UID: "4ae782ac-6eda-4a8e-bb95-ddf6a66832a3"). InnerVolumeSpecName "kube-api-access-r5t59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:55:10.119170 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.119152    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-data-science-collector-ta-server-cert" pod "4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" (UID: "4ae782ac-6eda-4a8e-bb95-ddf6a66832a3"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:55:10.217919 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.217885    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:10.217919 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.217918    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5t59\" (UniqueName: \"kubernetes.io/projected/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-kube-api-access-r5t59\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:10.218114 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.217930    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:55:10.635854 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.635772    5937 generic.go:356] "Generic (PLEG): container finished" podID="4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" containerID="ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e" exitCode=0
Oct 30 20:55:10.635854 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.635819    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"
Oct 30 20:55:10.636297 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.635865    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9" event={"ID":"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3","Type":"ContainerDied","Data":"ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e"}
Oct 30 20:55:10.636297 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.635907    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9" event={"ID":"4ae782ac-6eda-4a8e-bb95-ddf6a66832a3","Type":"ContainerDied","Data":"6cc7b2e828118dec614473140d193d726b254709e703781bec6501d0c3a4e2c9"}
Oct 30 20:55:10.636297 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.635931    5937 scope.go:122] "RemoveContainer" containerID="ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e"
Oct 30 20:55:10.645350 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.645333    5937 scope.go:122] "RemoveContainer" containerID="ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e"
Oct 30 20:55:10.645645 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:55:10.645625    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e\": container with ID starting with ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e not found: ID does not exist" containerID="ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e"
Oct 30 20:55:10.645690 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.645656    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e"} err="failed to get container status \"ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e\": rpc error: code = NotFound desc = could not find container \"ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e\": container with ID starting with ac155c86b9c2b82e5ad6920518e7f75fecb59b885c8c3848e29856318ca2f18e not found: ID does not exist"
Oct 30 20:55:10.801120 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.801091    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"]
Oct 30 20:55:10.852040 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:10.852007    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-74b986f996-qw9c9"]
Oct 30 20:55:11.161151 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:55:11.161114    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" path="/var/lib/kubelet/pods/4ae782ac-6eda-4a8e-bb95-ddf6a66832a3/volumes"
Oct 30 20:55:15.672577 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:55:15.672481    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:55:45.671775 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:55:45.671740    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:56:15.671564 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:56:15.671501    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:56:22.555921 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.555885    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41"]
Oct 30 20:56:22.558267 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.556256    5937 cpu_manager.go:414] "containerMap: removing container" podUID="4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" containerName="ta-container"
Oct 30 20:56:22.558267 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.556266    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" containerName="ta-container"
Oct 30 20:56:22.558267 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.556339    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ae782ac-6eda-4a8e-bb95-ddf6a66832a3" containerName="ta-container"
Oct 30 20:56:22.559164 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.559147    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41"
Oct 30 20:56:22.569995 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.569972    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41"
Oct 30 20:56:22.615439 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.615405    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41"]
Oct 30 20:56:22.941150 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.941005    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41"]
Oct 30 20:56:22.943672 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:56:22.943642    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda568de21_8846_4364_8a92_2ff2d3f8259c.slice/crio-39e88999cf1d63397023a5423fb8bbf9701a7d9d826bdb02861fb457bdffe73b WatchSource:0}: Error finding container 39e88999cf1d63397023a5423fb8bbf9701a7d9d826bdb02861fb457bdffe73b: Status 404 returned error can't find the container with id 39e88999cf1d63397023a5423fb8bbf9701a7d9d826bdb02861fb457bdffe73b
Oct 30 20:56:22.946150 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.946134    5937 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 20:56:22.968309 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:22.968275    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41" event={"ID":"a568de21-8846-4364-8a92-2ff2d3f8259c","Type":"ContainerStarted","Data":"39e88999cf1d63397023a5423fb8bbf9701a7d9d826bdb02861fb457bdffe73b"}
Oct 30 20:56:24.979445 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:24.979414    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41" event={"ID":"a568de21-8846-4364-8a92-2ff2d3f8259c","Type":"ContainerStarted","Data":"dd2408dfb210515f7ba18437cca021f4fde528e75b86baf73ebe2205c3ba1a40"}
Oct 30 20:56:25.095557 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:25.095472    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41" podStartSLOduration=1.177776473 podStartE2EDuration="3.09545494s" totalImagesPullingTime="1.917678467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:25.094611945 +0000 UTC m=+1160.050626722" watchObservedRunningTime="2026-10-30 20:56:25.09545494 +0000 UTC m=+1160.051469720"
Oct 30 20:56:30.002353 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:30.002319    5937 generic.go:356] "Generic (PLEG): container finished" podID="a568de21-8846-4364-8a92-2ff2d3f8259c" containerID="dd2408dfb210515f7ba18437cca021f4fde528e75b86baf73ebe2205c3ba1a40" exitCode=0
Oct 30 20:56:30.002780 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:30.002399    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41" event={"ID":"a568de21-8846-4364-8a92-2ff2d3f8259c","Type":"ContainerDied","Data":"dd2408dfb210515f7ba18437cca021f4fde528e75b86baf73ebe2205c3ba1a40"}
Oct 30 20:56:31.147078 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:31.147050    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41"
Oct 30 20:56:32.012826 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:32.012782    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41" event={"ID":"a568de21-8846-4364-8a92-2ff2d3f8259c","Type":"ContainerDied","Data":"39e88999cf1d63397023a5423fb8bbf9701a7d9d826bdb02861fb457bdffe73b"}
Oct 30 20:56:32.012826 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:32.012818    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41"
Oct 30 20:56:32.013119 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:32.012823    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39e88999cf1d63397023a5423fb8bbf9701a7d9d826bdb02861fb457bdffe73b"
Oct 30 20:56:32.673068 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:32.673026    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41"]
Oct 30 20:56:32.676894 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:32.676863    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/korrel8r-ingress-18e36a24b0906c41"]
Oct 30 20:56:33.161375 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:33.161341    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a568de21-8846-4364-8a92-2ff2d3f8259c" path="/var/lib/kubelet/pods/a568de21-8846-4364-8a92-2ff2d3f8259c/volumes"
Oct 30 20:56:45.672398 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:56:45.672312    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:56:49.973497 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:49.973463    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"]
Oct 30 20:56:49.973905 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:49.973858    5937 cpu_manager.go:414] "containerMap: removing container" podUID="a568de21-8846-4364-8a92-2ff2d3f8259c" containerName="curl"
Oct 30 20:56:49.973905 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:49.973870    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a568de21-8846-4364-8a92-2ff2d3f8259c" containerName="curl"
Oct 30 20:56:49.973978 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:49.973930    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="a568de21-8846-4364-8a92-2ff2d3f8259c" containerName="curl"
Oct 30 20:56:49.976827 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:49.976810    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.018703 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.018662    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4039406a-7d50-4b59-b4a9-0157e808fe7f-ta-internal\") pod \"data-science-collector-targetallocator-57ffdc584b-lvmpz\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.018873 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.018811    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62ffs\" (UniqueName: \"kubernetes.io/projected/4039406a-7d50-4b59-b4a9-0157e808fe7f-kube-api-access-62ffs\") pod \"data-science-collector-targetallocator-57ffdc584b-lvmpz\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.018873 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.018846    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4039406a-7d50-4b59-b4a9-0157e808fe7f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57ffdc584b-lvmpz\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.035506 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.035476    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"]
Oct 30 20:56:50.119971 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.119938    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62ffs\" (UniqueName: \"kubernetes.io/projected/4039406a-7d50-4b59-b4a9-0157e808fe7f-kube-api-access-62ffs\") pod \"data-science-collector-targetallocator-57ffdc584b-lvmpz\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.119971 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.119983    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4039406a-7d50-4b59-b4a9-0157e808fe7f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57ffdc584b-lvmpz\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.120197 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.120121    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4039406a-7d50-4b59-b4a9-0157e808fe7f-ta-internal\") pod \"data-science-collector-targetallocator-57ffdc584b-lvmpz\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.120790 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.120772    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4039406a-7d50-4b59-b4a9-0157e808fe7f-ta-internal\") pod \"data-science-collector-targetallocator-57ffdc584b-lvmpz\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.122812 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.122792    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4039406a-7d50-4b59-b4a9-0157e808fe7f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57ffdc584b-lvmpz\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.181903 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.181874    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62ffs\" (UniqueName: \"kubernetes.io/projected/4039406a-7d50-4b59-b4a9-0157e808fe7f-kube-api-access-62ffs\") pod \"data-science-collector-targetallocator-57ffdc584b-lvmpz\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.288783 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.288699    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:50.661557 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.661470    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"]
Oct 30 20:56:50.664336 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:56:50.664307    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4039406a_7d50_4b59_b4a9_0157e808fe7f.slice/crio-ffd3a6513795765a825d3d41114abf848e72ac6d0bbe622b0b3f706eeb9fdb6f WatchSource:0}: Error finding container ffd3a6513795765a825d3d41114abf848e72ac6d0bbe622b0b3f706eeb9fdb6f: Status 404 returned error can't find the container with id ffd3a6513795765a825d3d41114abf848e72ac6d0bbe622b0b3f706eeb9fdb6f
Oct 30 20:56:50.666626 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.666598    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:56:50.666707 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:50.666653    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:56:51.110276 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:51.110232    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz" event={"ID":"4039406a-7d50-4b59-b4a9-0157e808fe7f","Type":"ContainerStarted","Data":"f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618"}
Oct 30 20:56:51.110737 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:51.110283    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz" event={"ID":"4039406a-7d50-4b59-b4a9-0157e808fe7f","Type":"ContainerStarted","Data":"ffd3a6513795765a825d3d41114abf848e72ac6d0bbe622b0b3f706eeb9fdb6f"}
Oct 30 20:56:51.110737 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:51.110425    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:51.111643 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:51.111615    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz" podUID="4039406a-7d50-4b59-b4a9-0157e808fe7f" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.41:8080/readyz\": dial tcp 10.134.0.41:8080: connect: connection refused"
Oct 30 20:56:51.230190 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:51.230121    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz" podStartSLOduration=2.230102588 podStartE2EDuration="2.230102588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:56:51.229678519 +0000 UTC m=+1186.185693315" watchObservedRunningTime="2026-10-30 20:56:51.230102588 +0000 UTC m=+1186.186117364"
Oct 30 20:56:52.117025 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.116998    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:56:52.289448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.289409    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"]
Oct 30 20:56:52.289745 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.289698    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m" podUID="ca370601-3d95-4069-8859-d82102d8bc34" containerName="ta-container" containerID="cri-o://d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070" gracePeriod=30
Oct 30 20:56:52.537324 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.537295    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:56:52.642481 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.642447    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ca370601-3d95-4069-8859-d82102d8bc34-ta-internal\" (UniqueName: \"kubernetes.io/configmap/ca370601-3d95-4069-8859-d82102d8bc34-ta-internal\") pod \"ca370601-3d95-4069-8859-d82102d8bc34\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") "
Oct 30 20:56:52.642688 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.642575    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ca370601-3d95-4069-8859-d82102d8bc34-kube-api-access-qp25j\" (UniqueName: \"kubernetes.io/projected/ca370601-3d95-4069-8859-d82102d8bc34-kube-api-access-qp25j\") pod \"ca370601-3d95-4069-8859-d82102d8bc34\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") "
Oct 30 20:56:52.642688 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.642627    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ca370601-3d95-4069-8859-d82102d8bc34-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ca370601-3d95-4069-8859-d82102d8bc34-data-science-collector-ta-server-cert\") pod \"ca370601-3d95-4069-8859-d82102d8bc34\" (UID: \"ca370601-3d95-4069-8859-d82102d8bc34\") "
Oct 30 20:56:52.642923 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.642899    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca370601-3d95-4069-8859-d82102d8bc34-ta-internal" pod "ca370601-3d95-4069-8859-d82102d8bc34" (UID: "ca370601-3d95-4069-8859-d82102d8bc34"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:56:52.644984 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.644951    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca370601-3d95-4069-8859-d82102d8bc34-data-science-collector-ta-server-cert" pod "ca370601-3d95-4069-8859-d82102d8bc34" (UID: "ca370601-3d95-4069-8859-d82102d8bc34"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:56:52.645155 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.645136    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca370601-3d95-4069-8859-d82102d8bc34-kube-api-access-qp25j" pod "ca370601-3d95-4069-8859-d82102d8bc34" (UID: "ca370601-3d95-4069-8859-d82102d8bc34"). InnerVolumeSpecName "kube-api-access-qp25j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:56:52.744063 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.744021    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp25j\" (UniqueName: \"kubernetes.io/projected/ca370601-3d95-4069-8859-d82102d8bc34-kube-api-access-qp25j\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:52.744063 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.744057    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ca370601-3d95-4069-8859-d82102d8bc34-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:52.744063 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:52.744068    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ca370601-3d95-4069-8859-d82102d8bc34-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:56:53.121189 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:53.121099    5937 generic.go:356] "Generic (PLEG): container finished" podID="ca370601-3d95-4069-8859-d82102d8bc34" containerID="d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070" exitCode=0
Oct 30 20:56:53.121189 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:53.121143    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"
Oct 30 20:56:53.121699 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:53.121184    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m" event={"ID":"ca370601-3d95-4069-8859-d82102d8bc34","Type":"ContainerDied","Data":"d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070"}
Oct 30 20:56:53.121699 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:53.121232    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m" event={"ID":"ca370601-3d95-4069-8859-d82102d8bc34","Type":"ContainerDied","Data":"47d2bd93f5be545692b0a4505969114fe0bc676de4f29bd9da6278bcc863fe6c"}
Oct 30 20:56:53.121699 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:53.121254    5937 scope.go:122] "RemoveContainer" containerID="d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070"
Oct 30 20:56:53.130625 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:53.130610    5937 scope.go:122] "RemoveContainer" containerID="d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070"
Oct 30 20:56:53.130937 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:56:53.130918    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070\": container with ID starting with d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070 not found: ID does not exist" containerID="d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070"
Oct 30 20:56:53.130992 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:53.130946    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070"} err="failed to get container status \"d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070\": rpc error: code = NotFound desc = could not find container \"d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070\": container with ID starting with d2929255eaea936a909d5c10f7fa265258097539071e8799918034306f825070 not found: ID does not exist"
Oct 30 20:56:53.286841 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:53.286806    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"]
Oct 30 20:56:53.337367 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:53.337327    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5c69976bcc-9bk9m"]
Oct 30 20:56:55.160743 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:56:55.160711    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ca370601-3d95-4069-8859-d82102d8bc34" path="/var/lib/kubelet/pods/ca370601-3d95-4069-8859-d82102d8bc34/volumes"
Oct 30 20:57:15.672907 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:57:15.672866    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:57:23.125942 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.125905    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"]
Oct 30 20:57:23.126417 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.126287    5937 cpu_manager.go:414] "containerMap: removing container" podUID="ca370601-3d95-4069-8859-d82102d8bc34" containerName="ta-container"
Oct 30 20:57:23.126417 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.126300    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ca370601-3d95-4069-8859-d82102d8bc34" containerName="ta-container"
Oct 30 20:57:23.126417 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.126368    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="ca370601-3d95-4069-8859-d82102d8bc34" containerName="ta-container"
Oct 30 20:57:23.129470 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.129454    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.187719 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.187687    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"]
Oct 30 20:57:23.223783 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.223741    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j74dr\" (UniqueName: \"kubernetes.io/projected/68d75eec-db77-42a7-8cc2-747526be8ed8-kube-api-access-j74dr\") pod \"data-science-collector-targetallocator-7999ccd975-hlgpl\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.223970 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.223885    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/68d75eec-db77-42a7-8cc2-747526be8ed8-ta-internal\") pod \"data-science-collector-targetallocator-7999ccd975-hlgpl\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.223970 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.223934    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/68d75eec-db77-42a7-8cc2-747526be8ed8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7999ccd975-hlgpl\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.325518 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.325473    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/68d75eec-db77-42a7-8cc2-747526be8ed8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7999ccd975-hlgpl\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.325726 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.325573    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j74dr\" (UniqueName: \"kubernetes.io/projected/68d75eec-db77-42a7-8cc2-747526be8ed8-kube-api-access-j74dr\") pod \"data-science-collector-targetallocator-7999ccd975-hlgpl\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.325726 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.325648    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/68d75eec-db77-42a7-8cc2-747526be8ed8-ta-internal\") pod \"data-science-collector-targetallocator-7999ccd975-hlgpl\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.326247 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.326227    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/68d75eec-db77-42a7-8cc2-747526be8ed8-ta-internal\") pod \"data-science-collector-targetallocator-7999ccd975-hlgpl\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.328213 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.328193    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/68d75eec-db77-42a7-8cc2-747526be8ed8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7999ccd975-hlgpl\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.387775 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.387689    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j74dr\" (UniqueName: \"kubernetes.io/projected/68d75eec-db77-42a7-8cc2-747526be8ed8-kube-api-access-j74dr\") pod \"data-science-collector-targetallocator-7999ccd975-hlgpl\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.440814 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.440777    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:23.815047 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.815018    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"]
Oct 30 20:57:23.818030 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:57:23.818003    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68d75eec_db77_42a7_8cc2_747526be8ed8.slice/crio-54e5dc36cfddcf1b4de90101e1eb28f8f7d8543bb6315cab00c4cda28fe28250 WatchSource:0}: Error finding container 54e5dc36cfddcf1b4de90101e1eb28f8f7d8543bb6315cab00c4cda28fe28250: Status 404 returned error can't find the container with id 54e5dc36cfddcf1b4de90101e1eb28f8f7d8543bb6315cab00c4cda28fe28250
Oct 30 20:57:23.820713 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.820683    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:57:23.820818 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:23.820748    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:57:24.265272 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:24.265237    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl" event={"ID":"68d75eec-db77-42a7-8cc2-747526be8ed8","Type":"ContainerStarted","Data":"2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354"}
Oct 30 20:57:24.265702 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:24.265279    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl" event={"ID":"68d75eec-db77-42a7-8cc2-747526be8ed8","Type":"ContainerStarted","Data":"54e5dc36cfddcf1b4de90101e1eb28f8f7d8543bb6315cab00c4cda28fe28250"}
Oct 30 20:57:24.265702 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:24.265398    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:24.266634 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:24.266610    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl" podUID="68d75eec-db77-42a7-8cc2-747526be8ed8" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.42:8080/readyz\": dial tcp 10.134.0.42:8080: connect: connection refused"
Oct 30 20:57:24.385399 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:24.385335    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl" podStartSLOduration=1.385318341 podStartE2EDuration="1.385318341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:24.384476021 +0000 UTC m=+1219.340490821" watchObservedRunningTime="2026-10-30 20:57:24.385318341 +0000 UTC m=+1219.341333113"
Oct 30 20:57:25.270766 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.270734    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:25.440744 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.440715    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"]
Oct 30 20:57:25.440962 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.440938    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz" podUID="4039406a-7d50-4b59-b4a9-0157e808fe7f" containerName="ta-container" containerID="cri-o://f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618" gracePeriod=30
Oct 30 20:57:25.699121 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.699095    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:57:25.749184 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.749154    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4039406a-7d50-4b59-b4a9-0157e808fe7f-ta-internal\" (UniqueName: \"kubernetes.io/configmap/4039406a-7d50-4b59-b4a9-0157e808fe7f-ta-internal\") pod \"4039406a-7d50-4b59-b4a9-0157e808fe7f\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") "
Oct 30 20:57:25.749407 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.749209    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4039406a-7d50-4b59-b4a9-0157e808fe7f-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4039406a-7d50-4b59-b4a9-0157e808fe7f-data-science-collector-ta-server-cert\") pod \"4039406a-7d50-4b59-b4a9-0157e808fe7f\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") "
Oct 30 20:57:25.749565 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.749513    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4039406a-7d50-4b59-b4a9-0157e808fe7f-ta-internal" pod "4039406a-7d50-4b59-b4a9-0157e808fe7f" (UID: "4039406a-7d50-4b59-b4a9-0157e808fe7f"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:25.751531 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.751490    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4039406a-7d50-4b59-b4a9-0157e808fe7f-data-science-collector-ta-server-cert" pod "4039406a-7d50-4b59-b4a9-0157e808fe7f" (UID: "4039406a-7d50-4b59-b4a9-0157e808fe7f"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:25.850404 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.850316    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4039406a-7d50-4b59-b4a9-0157e808fe7f-kube-api-access-62ffs\" (UniqueName: \"kubernetes.io/projected/4039406a-7d50-4b59-b4a9-0157e808fe7f-kube-api-access-62ffs\") pod \"4039406a-7d50-4b59-b4a9-0157e808fe7f\" (UID: \"4039406a-7d50-4b59-b4a9-0157e808fe7f\") "
Oct 30 20:57:25.850627 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.850609    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4039406a-7d50-4b59-b4a9-0157e808fe7f-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:25.850686 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.850635    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4039406a-7d50-4b59-b4a9-0157e808fe7f-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:25.852702 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.852670    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4039406a-7d50-4b59-b4a9-0157e808fe7f-kube-api-access-62ffs" pod "4039406a-7d50-4b59-b4a9-0157e808fe7f" (UID: "4039406a-7d50-4b59-b4a9-0157e808fe7f"). InnerVolumeSpecName "kube-api-access-62ffs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:25.951104 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:25.951069    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62ffs\" (UniqueName: \"kubernetes.io/projected/4039406a-7d50-4b59-b4a9-0157e808fe7f-kube-api-access-62ffs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:26.280900 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:26.280864    5937 generic.go:356] "Generic (PLEG): container finished" podID="4039406a-7d50-4b59-b4a9-0157e808fe7f" containerID="f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618" exitCode=0
Oct 30 20:57:26.281421 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:26.280930    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"
Oct 30 20:57:26.281421 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:26.280948    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz" event={"ID":"4039406a-7d50-4b59-b4a9-0157e808fe7f","Type":"ContainerDied","Data":"f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618"}
Oct 30 20:57:26.281421 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:26.281000    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz" event={"ID":"4039406a-7d50-4b59-b4a9-0157e808fe7f","Type":"ContainerDied","Data":"ffd3a6513795765a825d3d41114abf848e72ac6d0bbe622b0b3f706eeb9fdb6f"}
Oct 30 20:57:26.281421 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:26.281024    5937 scope.go:122] "RemoveContainer" containerID="f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618"
Oct 30 20:57:26.290605 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:26.290586    5937 scope.go:122] "RemoveContainer" containerID="f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618"
Oct 30 20:57:26.291099 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:57:26.291079    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618\": container with ID starting with f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618 not found: ID does not exist" containerID="f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618"
Oct 30 20:57:26.291165 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:26.291109    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618"} err="failed to get container status \"f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618\": rpc error: code = NotFound desc = could not find container \"f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618\": container with ID starting with f4da8e9ee53c90dc93781370d9d079733d984cffb120c2b7fc20adc39f151618 not found: ID does not exist"
Oct 30 20:57:26.446959 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:26.446925    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"]
Oct 30 20:57:26.454386 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:26.454358    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57ffdc584b-lvmpz"]
Oct 30 20:57:27.160845 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:27.160810    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4039406a-7d50-4b59-b4a9-0157e808fe7f" path="/var/lib/kubelet/pods/4039406a-7d50-4b59-b4a9-0157e808fe7f/volumes"
Oct 30 20:57:45.672019 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:57:45.671979    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:57:56.283324 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.283289    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"]
Oct 30 20:57:56.283894 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.283725    5937 cpu_manager.go:414] "containerMap: removing container" podUID="4039406a-7d50-4b59-b4a9-0157e808fe7f" containerName="ta-container"
Oct 30 20:57:56.283894 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.283737    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4039406a-7d50-4b59-b4a9-0157e808fe7f" containerName="ta-container"
Oct 30 20:57:56.283894 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.283804    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="4039406a-7d50-4b59-b4a9-0157e808fe7f" containerName="ta-container"
Oct 30 20:57:56.286939 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.286918    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.347096 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.347067    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"]
Oct 30 20:57:56.421676 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.421636    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7qj\" (UniqueName: \"kubernetes.io/projected/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-kube-api-access-pg7qj\") pod \"data-science-collector-targetallocator-76455cdc9f-rb2tc\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.421852 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.421759    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-ta-internal\") pod \"data-science-collector-targetallocator-76455cdc9f-rb2tc\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.421852 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.421798    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76455cdc9f-rb2tc\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.522784 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.522743    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7qj\" (UniqueName: \"kubernetes.io/projected/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-kube-api-access-pg7qj\") pod \"data-science-collector-targetallocator-76455cdc9f-rb2tc\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.522985 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.522812    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-ta-internal\") pod \"data-science-collector-targetallocator-76455cdc9f-rb2tc\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.522985 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.522843    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76455cdc9f-rb2tc\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.523452 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.523430    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-ta-internal\") pod \"data-science-collector-targetallocator-76455cdc9f-rb2tc\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.525448 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.525430    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76455cdc9f-rb2tc\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.585354 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.585282    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7qj\" (UniqueName: \"kubernetes.io/projected/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-kube-api-access-pg7qj\") pod \"data-science-collector-targetallocator-76455cdc9f-rb2tc\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.599930 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.599900    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:56.974302 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.974255    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"]
Oct 30 20:57:56.979076 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:57:56.979043    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ad42971_76c2_4ecd_a10d_a2d7b32966a5.slice/crio-1b27fe85aad55bfce4624ec59b55c0495b67a4c76fda6bca3d0a20775fb66e38 WatchSource:0}: Error finding container 1b27fe85aad55bfce4624ec59b55c0495b67a4c76fda6bca3d0a20775fb66e38: Status 404 returned error can't find the container with id 1b27fe85aad55bfce4624ec59b55c0495b67a4c76fda6bca3d0a20775fb66e38
Oct 30 20:57:56.981771 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.981733    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:57:56.981887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:56.981804    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:57:57.432522 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:57.432431    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc" event={"ID":"5ad42971-76c2-4ecd-a10d-a2d7b32966a5","Type":"ContainerStarted","Data":"ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4"}
Oct 30 20:57:57.432522 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:57.432490    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc" event={"ID":"5ad42971-76c2-4ecd-a10d-a2d7b32966a5","Type":"ContainerStarted","Data":"1b27fe85aad55bfce4624ec59b55c0495b67a4c76fda6bca3d0a20775fb66e38"}
Oct 30 20:57:57.432975 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:57.432576    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:57.433945 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:57.433918    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc" podUID="5ad42971-76c2-4ecd-a10d-a2d7b32966a5" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.43:8080/readyz\": dial tcp 10.134.0.43:8080: connect: connection refused"
Oct 30 20:57:57.552512 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:57.552359    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc" podStartSLOduration=1.552330939 podStartE2EDuration="1.552330939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:57:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:57:57.551287869 +0000 UTC m=+1252.507302646" watchObservedRunningTime="2026-10-30 20:57:57.552330939 +0000 UTC m=+1252.508345718"
Oct 30 20:57:58.453618 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:58.451841    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:57:58.643106 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:58.643074    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"]
Oct 30 20:57:58.643324 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:58.643297    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl" podUID="68d75eec-db77-42a7-8cc2-747526be8ed8" containerName="ta-container" containerID="cri-o://2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354" gracePeriod=30
Oct 30 20:57:58.937035 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:58.937006    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:59.046460 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.046378    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/68d75eec-db77-42a7-8cc2-747526be8ed8-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/68d75eec-db77-42a7-8cc2-747526be8ed8-data-science-collector-ta-server-cert\") pod \"68d75eec-db77-42a7-8cc2-747526be8ed8\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") "
Oct 30 20:57:59.046460 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.046429    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/68d75eec-db77-42a7-8cc2-747526be8ed8-kube-api-access-j74dr\" (UniqueName: \"kubernetes.io/projected/68d75eec-db77-42a7-8cc2-747526be8ed8-kube-api-access-j74dr\") pod \"68d75eec-db77-42a7-8cc2-747526be8ed8\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") "
Oct 30 20:57:59.046714 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.046567    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/68d75eec-db77-42a7-8cc2-747526be8ed8-ta-internal\" (UniqueName: \"kubernetes.io/configmap/68d75eec-db77-42a7-8cc2-747526be8ed8-ta-internal\") pod \"68d75eec-db77-42a7-8cc2-747526be8ed8\" (UID: \"68d75eec-db77-42a7-8cc2-747526be8ed8\") "
Oct 30 20:57:59.046958 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.046926    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68d75eec-db77-42a7-8cc2-747526be8ed8-ta-internal" pod "68d75eec-db77-42a7-8cc2-747526be8ed8" (UID: "68d75eec-db77-42a7-8cc2-747526be8ed8"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:57:59.048928 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.048903    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68d75eec-db77-42a7-8cc2-747526be8ed8-kube-api-access-j74dr" pod "68d75eec-db77-42a7-8cc2-747526be8ed8" (UID: "68d75eec-db77-42a7-8cc2-747526be8ed8"). InnerVolumeSpecName "kube-api-access-j74dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:57:59.049096 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.048902    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68d75eec-db77-42a7-8cc2-747526be8ed8-data-science-collector-ta-server-cert" pod "68d75eec-db77-42a7-8cc2-747526be8ed8" (UID: "68d75eec-db77-42a7-8cc2-747526be8ed8"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:57:59.157253 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.157155    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/68d75eec-db77-42a7-8cc2-747526be8ed8-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:59.157253 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.157199    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/68d75eec-db77-42a7-8cc2-747526be8ed8-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:59.157253 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.157218    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j74dr\" (UniqueName: \"kubernetes.io/projected/68d75eec-db77-42a7-8cc2-747526be8ed8-kube-api-access-j74dr\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:57:59.457630 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.456329    5937 generic.go:356] "Generic (PLEG): container finished" podID="68d75eec-db77-42a7-8cc2-747526be8ed8" containerID="2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354" exitCode=0
Oct 30 20:57:59.457630 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.457169    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"
Oct 30 20:57:59.458424 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.458393    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl" event={"ID":"68d75eec-db77-42a7-8cc2-747526be8ed8","Type":"ContainerDied","Data":"2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354"}
Oct 30 20:57:59.458631 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.458442    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl" event={"ID":"68d75eec-db77-42a7-8cc2-747526be8ed8","Type":"ContainerDied","Data":"54e5dc36cfddcf1b4de90101e1eb28f8f7d8543bb6315cab00c4cda28fe28250"}
Oct 30 20:57:59.458631 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.458458    5937 scope.go:122] "RemoveContainer" containerID="2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354"
Oct 30 20:57:59.471257 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.470998    5937 scope.go:122] "RemoveContainer" containerID="2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354"
Oct 30 20:57:59.471471 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:57:59.471441    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354\": container with ID starting with 2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354 not found: ID does not exist" containerID="2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354"
Oct 30 20:57:59.471517 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.471489    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354"} err="failed to get container status \"2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354\": rpc error: code = NotFound desc = could not find container \"2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354\": container with ID starting with 2d8ae120381da2beecac9864287529c1499e8afcfa1983b6f4e6277d9b2bd354 not found: ID does not exist"
Oct 30 20:57:59.640772 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.640737    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"]
Oct 30 20:57:59.647733 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:57:59.647675    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7999ccd975-hlgpl"]
Oct 30 20:58:01.161024 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:01.160992    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="68d75eec-db77-42a7-8cc2-747526be8ed8" path="/var/lib/kubelet/pods/68d75eec-db77-42a7-8cc2-747526be8ed8/volumes"
Oct 30 20:58:15.672116 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:58:15.672033    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:58:29.535881 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.535851    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"]
Oct 30 20:58:29.536345 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.536327    5937 cpu_manager.go:414] "containerMap: removing container" podUID="68d75eec-db77-42a7-8cc2-747526be8ed8" containerName="ta-container"
Oct 30 20:58:29.536394 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.536348    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="68d75eec-db77-42a7-8cc2-747526be8ed8" containerName="ta-container"
Oct 30 20:58:29.536428 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.536403    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="68d75eec-db77-42a7-8cc2-747526be8ed8" containerName="ta-container"
Oct 30 20:58:29.539356 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.539341    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.598857 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.598831    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"]
Oct 30 20:58:29.642708 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.642679    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/71938881-2955-4dd9-ac54-322b1ddba88a-ta-internal\") pod \"data-science-collector-targetallocator-77fd47765d-4vqc6\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.642835 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.642743    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/71938881-2955-4dd9-ac54-322b1ddba88a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77fd47765d-4vqc6\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.642835 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.642815    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plvs6\" (UniqueName: \"kubernetes.io/projected/71938881-2955-4dd9-ac54-322b1ddba88a-kube-api-access-plvs6\") pod \"data-science-collector-targetallocator-77fd47765d-4vqc6\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.743809 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.743778    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/71938881-2955-4dd9-ac54-322b1ddba88a-ta-internal\") pod \"data-science-collector-targetallocator-77fd47765d-4vqc6\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.743957 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.743842    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/71938881-2955-4dd9-ac54-322b1ddba88a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77fd47765d-4vqc6\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.743957 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.743864    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plvs6\" (UniqueName: \"kubernetes.io/projected/71938881-2955-4dd9-ac54-322b1ddba88a-kube-api-access-plvs6\") pod \"data-science-collector-targetallocator-77fd47765d-4vqc6\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.744521 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.744496    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/71938881-2955-4dd9-ac54-322b1ddba88a-ta-internal\") pod \"data-science-collector-targetallocator-77fd47765d-4vqc6\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.746403 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.746376    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/71938881-2955-4dd9-ac54-322b1ddba88a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77fd47765d-4vqc6\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.806208 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.806151    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plvs6\" (UniqueName: \"kubernetes.io/projected/71938881-2955-4dd9-ac54-322b1ddba88a-kube-api-access-plvs6\") pod \"data-science-collector-targetallocator-77fd47765d-4vqc6\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:29.850278 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:29.850252    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:30.220628 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:30.220563    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"]
Oct 30 20:58:30.223486 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:58:30.223460    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71938881_2955_4dd9_ac54_322b1ddba88a.slice/crio-13e79b620ddf03cb199a9cb1fb4fe5b53c2f2b36ab1465aca958c838d1f1f7b1 WatchSource:0}: Error finding container 13e79b620ddf03cb199a9cb1fb4fe5b53c2f2b36ab1465aca958c838d1f1f7b1: Status 404 returned error can't find the container with id 13e79b620ddf03cb199a9cb1fb4fe5b53c2f2b36ab1465aca958c838d1f1f7b1
Oct 30 20:58:30.225685 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:30.225650    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:58:30.225793 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:30.225706    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:58:30.598882 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:30.598803    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6" event={"ID":"71938881-2955-4dd9-ac54-322b1ddba88a","Type":"ContainerStarted","Data":"bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394"}
Oct 30 20:58:30.598882 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:30.598851    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6" event={"ID":"71938881-2955-4dd9-ac54-322b1ddba88a","Type":"ContainerStarted","Data":"13e79b620ddf03cb199a9cb1fb4fe5b53c2f2b36ab1465aca958c838d1f1f7b1"}
Oct 30 20:58:30.599343 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:30.598979    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:30.600219 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:30.600194    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6" podUID="71938881-2955-4dd9-ac54-322b1ddba88a" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.44:8080/readyz\": dial tcp 10.134.0.44:8080: connect: connection refused"
Oct 30 20:58:30.717893 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:30.717839    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6" podStartSLOduration=1.717824716 podStartE2EDuration="1.717824716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:58:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:58:30.716870593 +0000 UTC m=+1285.672885370" watchObservedRunningTime="2026-10-30 20:58:30.717824716 +0000 UTC m=+1285.673839492"
Oct 30 20:58:31.603731 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:31.603707    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:58:31.755762 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:31.755734    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"]
Oct 30 20:58:31.755926 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:31.755903    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc" podUID="5ad42971-76c2-4ecd-a10d-a2d7b32966a5" containerName="ta-container" containerID="cri-o://ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4" gracePeriod=30
Oct 30 20:58:32.004236 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.004212    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:58:32.064856 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.064829    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-data-science-collector-ta-server-cert\") pod \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") "
Oct 30 20:58:32.065003 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.064963    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-kube-api-access-pg7qj\" (UniqueName: \"kubernetes.io/projected/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-kube-api-access-pg7qj\") pod \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") "
Oct 30 20:58:32.065003 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.064993    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-ta-internal\") pod \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\" (UID: \"5ad42971-76c2-4ecd-a10d-a2d7b32966a5\") "
Oct 30 20:58:32.065324 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.065298    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-ta-internal" pod "5ad42971-76c2-4ecd-a10d-a2d7b32966a5" (UID: "5ad42971-76c2-4ecd-a10d-a2d7b32966a5"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:58:32.067084 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.067047    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-kube-api-access-pg7qj" pod "5ad42971-76c2-4ecd-a10d-a2d7b32966a5" (UID: "5ad42971-76c2-4ecd-a10d-a2d7b32966a5"). InnerVolumeSpecName "kube-api-access-pg7qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:58:32.067172 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.067150    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-data-science-collector-ta-server-cert" pod "5ad42971-76c2-4ecd-a10d-a2d7b32966a5" (UID: "5ad42971-76c2-4ecd-a10d-a2d7b32966a5"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:58:32.166412 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.166341    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:32.166412 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.166365    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg7qj\" (UniqueName: \"kubernetes.io/projected/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-kube-api-access-pg7qj\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:32.166412 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.166375    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ad42971-76c2-4ecd-a10d-a2d7b32966a5-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:58:32.608224 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.608191    5937 generic.go:356] "Generic (PLEG): container finished" podID="5ad42971-76c2-4ecd-a10d-a2d7b32966a5" containerID="ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4" exitCode=0
Oct 30 20:58:32.608660 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.608252    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc" event={"ID":"5ad42971-76c2-4ecd-a10d-a2d7b32966a5","Type":"ContainerDied","Data":"ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4"}
Oct 30 20:58:32.608660 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.608290    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc" event={"ID":"5ad42971-76c2-4ecd-a10d-a2d7b32966a5","Type":"ContainerDied","Data":"1b27fe85aad55bfce4624ec59b55c0495b67a4c76fda6bca3d0a20775fb66e38"}
Oct 30 20:58:32.608660 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.608301    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"
Oct 30 20:58:32.608660 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.608309    5937 scope.go:122] "RemoveContainer" containerID="ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4"
Oct 30 20:58:32.616999 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.616980    5937 scope.go:122] "RemoveContainer" containerID="ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4"
Oct 30 20:58:32.617256 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:58:32.617238    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4\": container with ID starting with ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4 not found: ID does not exist" containerID="ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4"
Oct 30 20:58:32.617318 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.617267    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4"} err="failed to get container status \"ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4\": rpc error: code = NotFound desc = could not find container \"ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4\": container with ID starting with ba02b57a068fc1054145a203bc04ace26f191de348e2a7df982accb6be908dc4 not found: ID does not exist"
Oct 30 20:58:32.777238 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.777211    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"]
Oct 30 20:58:32.781740 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:32.781719    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76455cdc9f-rb2tc"]
Oct 30 20:58:33.162043 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:58:33.162014    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ad42971-76c2-4ecd-a10d-a2d7b32966a5" path="/var/lib/kubelet/pods/5ad42971-76c2-4ecd-a10d-a2d7b32966a5/volumes"
Oct 30 20:58:45.670816 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:58:45.670780    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:59:14.196239 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.196211    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"]
Oct 30 20:59:14.196731 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.196576    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5ad42971-76c2-4ecd-a10d-a2d7b32966a5" containerName="ta-container"
Oct 30 20:59:14.196731 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.196587    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ad42971-76c2-4ecd-a10d-a2d7b32966a5" containerName="ta-container"
Oct 30 20:59:14.196731 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.196673    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ad42971-76c2-4ecd-a10d-a2d7b32966a5" containerName="ta-container"
Oct 30 20:59:14.201043 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.201027    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.259887 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.259860    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"]
Oct 30 20:59:14.316820 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.316792    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/290c7cac-5f56-42d9-8c4e-07f581b40744-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-c69886897-p8jzp\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.316983 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.316843    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7rpb\" (UniqueName: \"kubernetes.io/projected/290c7cac-5f56-42d9-8c4e-07f581b40744-kube-api-access-c7rpb\") pod \"data-science-collector-targetallocator-c69886897-p8jzp\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.316983 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.316941    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/290c7cac-5f56-42d9-8c4e-07f581b40744-ta-internal\") pod \"data-science-collector-targetallocator-c69886897-p8jzp\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.417947 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.417911    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/290c7cac-5f56-42d9-8c4e-07f581b40744-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-c69886897-p8jzp\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.417947 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.417951    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7rpb\" (UniqueName: \"kubernetes.io/projected/290c7cac-5f56-42d9-8c4e-07f581b40744-kube-api-access-c7rpb\") pod \"data-science-collector-targetallocator-c69886897-p8jzp\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.418189 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.417977    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/290c7cac-5f56-42d9-8c4e-07f581b40744-ta-internal\") pod \"data-science-collector-targetallocator-c69886897-p8jzp\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.418584 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.418560    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/290c7cac-5f56-42d9-8c4e-07f581b40744-ta-internal\") pod \"data-science-collector-targetallocator-c69886897-p8jzp\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.420515 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.420491    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/290c7cac-5f56-42d9-8c4e-07f581b40744-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-c69886897-p8jzp\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.480816 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.480790    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7rpb\" (UniqueName: \"kubernetes.io/projected/290c7cac-5f56-42d9-8c4e-07f581b40744-kube-api-access-c7rpb\") pod \"data-science-collector-targetallocator-c69886897-p8jzp\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.512636 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.512605    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:14.882981 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.882881    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"]
Oct 30 20:59:14.885819 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:59:14.885786    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod290c7cac_5f56_42d9_8c4e_07f581b40744.slice/crio-fb751610514895295e9d42e17ffd59a2a4a217f119113be5c5f36afdbf92615b WatchSource:0}: Error finding container fb751610514895295e9d42e17ffd59a2a4a217f119113be5c5f36afdbf92615b: Status 404 returned error can't find the container with id fb751610514895295e9d42e17ffd59a2a4a217f119113be5c5f36afdbf92615b
Oct 30 20:59:14.888006 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.887973    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:59:14.888094 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:14.888031    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:59:15.670912 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:59:15.670869    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:59:15.805757 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:15.805729    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp" event={"ID":"290c7cac-5f56-42d9-8c4e-07f581b40744","Type":"ContainerStarted","Data":"361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498"}
Oct 30 20:59:15.805919 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:15.805765    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp" event={"ID":"290c7cac-5f56-42d9-8c4e-07f581b40744","Type":"ContainerStarted","Data":"fb751610514895295e9d42e17ffd59a2a4a217f119113be5c5f36afdbf92615b"}
Oct 30 20:59:15.805919 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:15.805895    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:15.806814 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:15.806789    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp" podUID="290c7cac-5f56-42d9-8c4e-07f581b40744" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.45:8080/readyz\": dial tcp 10.134.0.45:8080: connect: connection refused"
Oct 30 20:59:15.925323 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:15.925211    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp" podStartSLOduration=1.9251969839999998 podStartE2EDuration="1.925196984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:15.924770418 +0000 UTC m=+1330.880785196" watchObservedRunningTime="2026-10-30 20:59:15.925196984 +0000 UTC m=+1330.881211835"
Oct 30 20:59:16.811624 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:16.811595    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:16.982481 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:16.982438    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"]
Oct 30 20:59:16.982686 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:16.982644    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6" podUID="71938881-2955-4dd9-ac54-322b1ddba88a" containerName="ta-container" containerID="cri-o://bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394" gracePeriod=30
Oct 30 20:59:17.224111 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.224084    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:59:17.339758 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.339724    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/71938881-2955-4dd9-ac54-322b1ddba88a-ta-internal\" (UniqueName: \"kubernetes.io/configmap/71938881-2955-4dd9-ac54-322b1ddba88a-ta-internal\") pod \"71938881-2955-4dd9-ac54-322b1ddba88a\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") "
Oct 30 20:59:17.339930 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.339825    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/71938881-2955-4dd9-ac54-322b1ddba88a-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/71938881-2955-4dd9-ac54-322b1ddba88a-data-science-collector-ta-server-cert\") pod \"71938881-2955-4dd9-ac54-322b1ddba88a\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") "
Oct 30 20:59:17.339930 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.339860    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/71938881-2955-4dd9-ac54-322b1ddba88a-kube-api-access-plvs6\" (UniqueName: \"kubernetes.io/projected/71938881-2955-4dd9-ac54-322b1ddba88a-kube-api-access-plvs6\") pod \"71938881-2955-4dd9-ac54-322b1ddba88a\" (UID: \"71938881-2955-4dd9-ac54-322b1ddba88a\") "
Oct 30 20:59:17.340748 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.340126    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71938881-2955-4dd9-ac54-322b1ddba88a-ta-internal" pod "71938881-2955-4dd9-ac54-322b1ddba88a" (UID: "71938881-2955-4dd9-ac54-322b1ddba88a"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:17.340748 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.340194    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/71938881-2955-4dd9-ac54-322b1ddba88a-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.342122 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.342100    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71938881-2955-4dd9-ac54-322b1ddba88a-data-science-collector-ta-server-cert" pod "71938881-2955-4dd9-ac54-322b1ddba88a" (UID: "71938881-2955-4dd9-ac54-322b1ddba88a"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:17.342370 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.342308    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71938881-2955-4dd9-ac54-322b1ddba88a-kube-api-access-plvs6" pod "71938881-2955-4dd9-ac54-322b1ddba88a" (UID: "71938881-2955-4dd9-ac54-322b1ddba88a"). InnerVolumeSpecName "kube-api-access-plvs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:17.440901 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.440868    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/71938881-2955-4dd9-ac54-322b1ddba88a-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.440901 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.440893    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plvs6\" (UniqueName: \"kubernetes.io/projected/71938881-2955-4dd9-ac54-322b1ddba88a-kube-api-access-plvs6\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:17.816934 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.816896    5937 generic.go:356] "Generic (PLEG): container finished" podID="71938881-2955-4dd9-ac54-322b1ddba88a" containerID="bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394" exitCode=0
Oct 30 20:59:17.817329 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.816936    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6" event={"ID":"71938881-2955-4dd9-ac54-322b1ddba88a","Type":"ContainerDied","Data":"bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394"}
Oct 30 20:59:17.817329 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.816964    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"
Oct 30 20:59:17.817329 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.816976    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6" event={"ID":"71938881-2955-4dd9-ac54-322b1ddba88a","Type":"ContainerDied","Data":"13e79b620ddf03cb199a9cb1fb4fe5b53c2f2b36ab1465aca958c838d1f1f7b1"}
Oct 30 20:59:17.817329 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.816997    5937 scope.go:122] "RemoveContainer" containerID="bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394"
Oct 30 20:59:17.825881 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.825862    5937 scope.go:122] "RemoveContainer" containerID="bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394"
Oct 30 20:59:17.826127 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:59:17.826108    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394\": container with ID starting with bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394 not found: ID does not exist" containerID="bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394"
Oct 30 20:59:17.826180 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.826137    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394"} err="failed to get container status \"bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394\": rpc error: code = NotFound desc = could not find container \"bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394\": container with ID starting with bce74a85425b66a39a0962c9cb6c0c94d613e3cf264d31f62e91a0cea84f4394 not found: ID does not exist"
Oct 30 20:59:17.983841 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:17.983809    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"]
Oct 30 20:59:18.034108 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:18.034074    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77fd47765d-4vqc6"]
Oct 30 20:59:19.160382 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:19.160350    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="71938881-2955-4dd9-ac54-322b1ddba88a" path="/var/lib/kubelet/pods/71938881-2955-4dd9-ac54-322b1ddba88a/volumes"
Oct 30 20:59:45.536173 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.536100    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"]
Oct 30 20:59:45.536597 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.536448    5937 cpu_manager.go:414] "containerMap: removing container" podUID="71938881-2955-4dd9-ac54-322b1ddba88a" containerName="ta-container"
Oct 30 20:59:45.536597 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.536463    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="71938881-2955-4dd9-ac54-322b1ddba88a" containerName="ta-container"
Oct 30 20:59:45.536674 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.536608    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="71938881-2955-4dd9-ac54-322b1ddba88a" containerName="ta-container"
Oct 30 20:59:45.539755 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.539739    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.581832 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.581806    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/06b1f39a-535c-426e-9475-5cdddca4f90e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-557f6ccbfb-kc82t\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.581934 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.581856    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/06b1f39a-535c-426e-9475-5cdddca4f90e-ta-internal\") pod \"data-science-collector-targetallocator-557f6ccbfb-kc82t\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.581934 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.581917    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvqzw\" (UniqueName: \"kubernetes.io/projected/06b1f39a-535c-426e-9475-5cdddca4f90e-kube-api-access-xvqzw\") pod \"data-science-collector-targetallocator-557f6ccbfb-kc82t\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.599201 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.599175    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"]
Oct 30 20:59:45.672415 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:59:45.672386    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 20:59:45.682870 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.682851    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/06b1f39a-535c-426e-9475-5cdddca4f90e-ta-internal\") pod \"data-science-collector-targetallocator-557f6ccbfb-kc82t\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.682972 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.682879    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvqzw\" (UniqueName: \"kubernetes.io/projected/06b1f39a-535c-426e-9475-5cdddca4f90e-kube-api-access-xvqzw\") pod \"data-science-collector-targetallocator-557f6ccbfb-kc82t\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.682972 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.682945    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/06b1f39a-535c-426e-9475-5cdddca4f90e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-557f6ccbfb-kc82t\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.683530 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.683498    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/06b1f39a-535c-426e-9475-5cdddca4f90e-ta-internal\") pod \"data-science-collector-targetallocator-557f6ccbfb-kc82t\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.685414 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.685392    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/06b1f39a-535c-426e-9475-5cdddca4f90e-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-557f6ccbfb-kc82t\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.745027 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.744998    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvqzw\" (UniqueName: \"kubernetes.io/projected/06b1f39a-535c-426e-9475-5cdddca4f90e-kube-api-access-xvqzw\") pod \"data-science-collector-targetallocator-557f6ccbfb-kc82t\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:45.851308 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:45.851252    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:46.223572 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:46.223526    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"]
Oct 30 20:59:46.226208 ip-10-0-141-37 kubenswrapper[5937]: W1030 20:59:46.226181    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06b1f39a_535c_426e_9475_5cdddca4f90e.slice/crio-a99bc800dc33b930222a514fd90323dad77580dd75a1500d2234113e04c09b28 WatchSource:0}: Error finding container a99bc800dc33b930222a514fd90323dad77580dd75a1500d2234113e04c09b28: Status 404 returned error can't find the container with id a99bc800dc33b930222a514fd90323dad77580dd75a1500d2234113e04c09b28
Oct 30 20:59:46.228474 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:46.228433    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:59:46.228603 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:46.228517    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 20:59:46.947333 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:46.947304    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t" event={"ID":"06b1f39a-535c-426e-9475-5cdddca4f90e","Type":"ContainerStarted","Data":"51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a"}
Oct 30 20:59:46.947333 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:46.947339    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t" event={"ID":"06b1f39a-535c-426e-9475-5cdddca4f90e","Type":"ContainerStarted","Data":"a99bc800dc33b930222a514fd90323dad77580dd75a1500d2234113e04c09b28"}
Oct 30 20:59:46.947794 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:46.947457    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:46.948696 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:46.948670    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t" podUID="06b1f39a-535c-426e-9475-5cdddca4f90e" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.46:8080/readyz\": dial tcp 10.134.0.46:8080: connect: connection refused"
Oct 30 20:59:47.066152 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:47.066098    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t" podStartSLOduration=2.066080763 podStartE2EDuration="2.066080763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 20:59:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 20:59:47.065454472 +0000 UTC m=+1362.021469253" watchObservedRunningTime="2026-10-30 20:59:47.066080763 +0000 UTC m=+1362.022095539"
Oct 30 20:59:47.952480 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:47.952455    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 20:59:48.127462 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.127421    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"]
Oct 30 20:59:48.127697 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.127670    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp" podUID="290c7cac-5f56-42d9-8c4e-07f581b40744" containerName="ta-container" containerID="cri-o://361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498" gracePeriod=30
Oct 30 20:59:48.376238 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.376214    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:48.510269 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.510178    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/290c7cac-5f56-42d9-8c4e-07f581b40744-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/290c7cac-5f56-42d9-8c4e-07f581b40744-data-science-collector-ta-server-cert\") pod \"290c7cac-5f56-42d9-8c4e-07f581b40744\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") "
Oct 30 20:59:48.510269 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.510265    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/290c7cac-5f56-42d9-8c4e-07f581b40744-kube-api-access-c7rpb\" (UniqueName: \"kubernetes.io/projected/290c7cac-5f56-42d9-8c4e-07f581b40744-kube-api-access-c7rpb\") pod \"290c7cac-5f56-42d9-8c4e-07f581b40744\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") "
Oct 30 20:59:48.510504 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.510388    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/290c7cac-5f56-42d9-8c4e-07f581b40744-ta-internal\" (UniqueName: \"kubernetes.io/configmap/290c7cac-5f56-42d9-8c4e-07f581b40744-ta-internal\") pod \"290c7cac-5f56-42d9-8c4e-07f581b40744\" (UID: \"290c7cac-5f56-42d9-8c4e-07f581b40744\") "
Oct 30 20:59:48.511047 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.510966    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/290c7cac-5f56-42d9-8c4e-07f581b40744-ta-internal" pod "290c7cac-5f56-42d9-8c4e-07f581b40744" (UID: "290c7cac-5f56-42d9-8c4e-07f581b40744"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 20:59:48.512725 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.512695    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/290c7cac-5f56-42d9-8c4e-07f581b40744-data-science-collector-ta-server-cert" pod "290c7cac-5f56-42d9-8c4e-07f581b40744" (UID: "290c7cac-5f56-42d9-8c4e-07f581b40744"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 20:59:48.512934 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.512915    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/290c7cac-5f56-42d9-8c4e-07f581b40744-kube-api-access-c7rpb" pod "290c7cac-5f56-42d9-8c4e-07f581b40744" (UID: "290c7cac-5f56-42d9-8c4e-07f581b40744"). InnerVolumeSpecName "kube-api-access-c7rpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 20:59:48.611250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.611223    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/290c7cac-5f56-42d9-8c4e-07f581b40744-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:48.611250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.611247    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/290c7cac-5f56-42d9-8c4e-07f581b40744-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:48.611250 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.611256    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7rpb\" (UniqueName: \"kubernetes.io/projected/290c7cac-5f56-42d9-8c4e-07f581b40744-kube-api-access-c7rpb\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 20:59:48.959013 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.958977    5937 generic.go:356] "Generic (PLEG): container finished" podID="290c7cac-5f56-42d9-8c4e-07f581b40744" containerID="361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498" exitCode=0
Oct 30 20:59:48.959492 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.959043    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"
Oct 30 20:59:48.959492 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.959064    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp" event={"ID":"290c7cac-5f56-42d9-8c4e-07f581b40744","Type":"ContainerDied","Data":"361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498"}
Oct 30 20:59:48.959492 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.959105    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp" event={"ID":"290c7cac-5f56-42d9-8c4e-07f581b40744","Type":"ContainerDied","Data":"fb751610514895295e9d42e17ffd59a2a4a217f119113be5c5f36afdbf92615b"}
Oct 30 20:59:48.959492 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.959123    5937 scope.go:122] "RemoveContainer" containerID="361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498"
Oct 30 20:59:48.968485 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.968456    5937 scope.go:122] "RemoveContainer" containerID="361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498"
Oct 30 20:59:48.968775 ip-10-0-141-37 kubenswrapper[5937]: E1030 20:59:48.968757    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498\": container with ID starting with 361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498 not found: ID does not exist" containerID="361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498"
Oct 30 20:59:48.968833 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:48.968784    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498"} err="failed to get container status \"361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498\": rpc error: code = NotFound desc = could not find container \"361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498\": container with ID starting with 361422ad001deddf11bf6cdc5ab63021c77eda19ce811e80f584dec0da7c6498 not found: ID does not exist"
Oct 30 20:59:49.126313 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:49.126273    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"]
Oct 30 20:59:49.130666 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:49.130635    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-c69886897-p8jzp"]
Oct 30 20:59:49.161549 ip-10-0-141-37 kubenswrapper[5937]: I1030 20:59:49.161507    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="290c7cac-5f56-42d9-8c4e-07f581b40744" path="/var/lib/kubelet/pods/290c7cac-5f56-42d9-8c4e-07f581b40744/volumes"
Oct 30 21:00:15.672269 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:00:15.672226    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:00:18.113867 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.113830    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"]
Oct 30 21:00:18.114297 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.114235    5937 cpu_manager.go:414] "containerMap: removing container" podUID="290c7cac-5f56-42d9-8c4e-07f581b40744" containerName="ta-container"
Oct 30 21:00:18.114297 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.114250    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="290c7cac-5f56-42d9-8c4e-07f581b40744" containerName="ta-container"
Oct 30 21:00:18.114377 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.114322    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="290c7cac-5f56-42d9-8c4e-07f581b40744" containerName="ta-container"
Oct 30 21:00:18.118777 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.118760    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.172379 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.172349    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kffhp\" (UniqueName: \"kubernetes.io/projected/60532b1b-0605-4116-a59d-67d5dde59435-kube-api-access-kffhp\") pod \"data-science-collector-targetallocator-745f659767-mqc8h\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.172516 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.172410    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/60532b1b-0605-4116-a59d-67d5dde59435-ta-internal\") pod \"data-science-collector-targetallocator-745f659767-mqc8h\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.172630 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.172573    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/60532b1b-0605-4116-a59d-67d5dde59435-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-745f659767-mqc8h\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.175389 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.175355    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"]
Oct 30 21:00:18.273442 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.273411    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kffhp\" (UniqueName: \"kubernetes.io/projected/60532b1b-0605-4116-a59d-67d5dde59435-kube-api-access-kffhp\") pod \"data-science-collector-targetallocator-745f659767-mqc8h\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.273642 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.273466    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/60532b1b-0605-4116-a59d-67d5dde59435-ta-internal\") pod \"data-science-collector-targetallocator-745f659767-mqc8h\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.273642 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.273500    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/60532b1b-0605-4116-a59d-67d5dde59435-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-745f659767-mqc8h\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.274142 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.274121    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/60532b1b-0605-4116-a59d-67d5dde59435-ta-internal\") pod \"data-science-collector-targetallocator-745f659767-mqc8h\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.276019 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.275999    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/60532b1b-0605-4116-a59d-67d5dde59435-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-745f659767-mqc8h\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.335927 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.335896    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kffhp\" (UniqueName: \"kubernetes.io/projected/60532b1b-0605-4116-a59d-67d5dde59435-kube-api-access-kffhp\") pod \"data-science-collector-targetallocator-745f659767-mqc8h\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.430588 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.430507    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:18.805729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.805636    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"]
Oct 30 21:00:18.808251 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:00:18.808223    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60532b1b_0605_4116_a59d_67d5dde59435.slice/crio-0d04ef7764323fffc64e1c9f762e2601ae1bf9e83d1faa36d925c6e3a9d6fde2 WatchSource:0}: Error finding container 0d04ef7764323fffc64e1c9f762e2601ae1bf9e83d1faa36d925c6e3a9d6fde2: Status 404 returned error can't find the container with id 0d04ef7764323fffc64e1c9f762e2601ae1bf9e83d1faa36d925c6e3a9d6fde2
Oct 30 21:00:18.810453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.810425    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:00:18.810573 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:18.810477    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:00:19.093587 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:19.093486    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h" event={"ID":"60532b1b-0605-4116-a59d-67d5dde59435","Type":"ContainerStarted","Data":"653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5"}
Oct 30 21:00:19.093587 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:19.093529    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h" event={"ID":"60532b1b-0605-4116-a59d-67d5dde59435","Type":"ContainerStarted","Data":"0d04ef7764323fffc64e1c9f762e2601ae1bf9e83d1faa36d925c6e3a9d6fde2"}
Oct 30 21:00:19.093778 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:19.093722    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:19.094691 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:19.094662    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h" podUID="60532b1b-0605-4116-a59d-67d5dde59435" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.47:8080/readyz\": dial tcp 10.134.0.47:8080: connect: connection refused"
Oct 30 21:00:19.212457 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:19.212402    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h" podStartSLOduration=1.21238877 podStartE2EDuration="1.21238877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:19.211691446 +0000 UTC m=+1394.167706224" watchObservedRunningTime="2026-10-30 21:00:19.21238877 +0000 UTC m=+1394.168403540"
Oct 30 21:00:20.099828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.099800    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:00:20.250142 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.250112    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"]
Oct 30 21:00:20.250573 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.250334    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t" podUID="06b1f39a-535c-426e-9475-5cdddca4f90e" containerName="ta-container" containerID="cri-o://51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a" gracePeriod=30
Oct 30 21:00:20.498112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.498082    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 21:00:20.589802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.589770    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06b1f39a-535c-426e-9475-5cdddca4f90e-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/06b1f39a-535c-426e-9475-5cdddca4f90e-data-science-collector-ta-server-cert\") pod \"06b1f39a-535c-426e-9475-5cdddca4f90e\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") "
Oct 30 21:00:20.589992 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.589814    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06b1f39a-535c-426e-9475-5cdddca4f90e-ta-internal\" (UniqueName: \"kubernetes.io/configmap/06b1f39a-535c-426e-9475-5cdddca4f90e-ta-internal\") pod \"06b1f39a-535c-426e-9475-5cdddca4f90e\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") "
Oct 30 21:00:20.589992 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.589904    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06b1f39a-535c-426e-9475-5cdddca4f90e-kube-api-access-xvqzw\" (UniqueName: \"kubernetes.io/projected/06b1f39a-535c-426e-9475-5cdddca4f90e-kube-api-access-xvqzw\") pod \"06b1f39a-535c-426e-9475-5cdddca4f90e\" (UID: \"06b1f39a-535c-426e-9475-5cdddca4f90e\") "
Oct 30 21:00:20.590265 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.590239    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b1f39a-535c-426e-9475-5cdddca4f90e-ta-internal" pod "06b1f39a-535c-426e-9475-5cdddca4f90e" (UID: "06b1f39a-535c-426e-9475-5cdddca4f90e"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:00:20.592055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.592033    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b1f39a-535c-426e-9475-5cdddca4f90e-kube-api-access-xvqzw" pod "06b1f39a-535c-426e-9475-5cdddca4f90e" (UID: "06b1f39a-535c-426e-9475-5cdddca4f90e"). InnerVolumeSpecName "kube-api-access-xvqzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:00:20.592137 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.592090    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b1f39a-535c-426e-9475-5cdddca4f90e-data-science-collector-ta-server-cert" pod "06b1f39a-535c-426e-9475-5cdddca4f90e" (UID: "06b1f39a-535c-426e-9475-5cdddca4f90e"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:00:20.690592 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.690488    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvqzw\" (UniqueName: \"kubernetes.io/projected/06b1f39a-535c-426e-9475-5cdddca4f90e-kube-api-access-xvqzw\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:20.690592 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.690517    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/06b1f39a-535c-426e-9475-5cdddca4f90e-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:20.690592 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:20.690561    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/06b1f39a-535c-426e-9475-5cdddca4f90e-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:00:21.104300 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:21.104271    5937 generic.go:356] "Generic (PLEG): container finished" podID="06b1f39a-535c-426e-9475-5cdddca4f90e" containerID="51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a" exitCode=0
Oct 30 21:00:21.104472 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:21.104321    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"
Oct 30 21:00:21.104472 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:21.104359    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t" event={"ID":"06b1f39a-535c-426e-9475-5cdddca4f90e","Type":"ContainerDied","Data":"51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a"}
Oct 30 21:00:21.104472 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:21.104400    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t" event={"ID":"06b1f39a-535c-426e-9475-5cdddca4f90e","Type":"ContainerDied","Data":"a99bc800dc33b930222a514fd90323dad77580dd75a1500d2234113e04c09b28"}
Oct 30 21:00:21.104472 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:21.104419    5937 scope.go:122] "RemoveContainer" containerID="51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a"
Oct 30 21:00:21.113804 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:21.113785    5937 scope.go:122] "RemoveContainer" containerID="51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a"
Oct 30 21:00:21.114077 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:00:21.114060    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a\": container with ID starting with 51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a not found: ID does not exist" containerID="51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a"
Oct 30 21:00:21.114125 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:21.114087    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a"} err="failed to get container status \"51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a\": rpc error: code = NotFound desc = could not find container \"51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a\": container with ID starting with 51e741c9cff018bc9300539670d914cc9d4a8cdd66a8da09d7b31bd4cef1e89a not found: ID does not exist"
Oct 30 21:00:21.271213 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:21.271179    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"]
Oct 30 21:00:21.321485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:21.321455    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-557f6ccbfb-kc82t"]
Oct 30 21:00:23.160291 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:23.160260    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06b1f39a-535c-426e-9475-5cdddca4f90e" path="/var/lib/kubelet/pods/06b1f39a-535c-426e-9475-5cdddca4f90e/volumes"
Oct 30 21:00:45.673746 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:00:45.673713    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:00:51.427227 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.427185    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"]
Oct 30 21:00:51.427754 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.427627    5937 cpu_manager.go:414] "containerMap: removing container" podUID="06b1f39a-535c-426e-9475-5cdddca4f90e" containerName="ta-container"
Oct 30 21:00:51.427754 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.427640    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06b1f39a-535c-426e-9475-5cdddca4f90e" containerName="ta-container"
Oct 30 21:00:51.427754 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.427705    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="06b1f39a-535c-426e-9475-5cdddca4f90e" containerName="ta-container"
Oct 30 21:00:51.431307 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.431289    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.536626 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.536594    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"]
Oct 30 21:00:51.536967 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.536946    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a3d90da-0256-4466-ace8-d952fd6d5e09-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7f7b754f5d-2kq2c\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.537033 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.536982    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sqk4\" (UniqueName: \"kubernetes.io/projected/8a3d90da-0256-4466-ace8-d952fd6d5e09-kube-api-access-8sqk4\") pod \"data-science-collector-targetallocator-7f7b754f5d-2kq2c\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.537033 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.537015    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a3d90da-0256-4466-ace8-d952fd6d5e09-ta-internal\") pod \"data-science-collector-targetallocator-7f7b754f5d-2kq2c\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.638220 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.638192    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a3d90da-0256-4466-ace8-d952fd6d5e09-ta-internal\") pod \"data-science-collector-targetallocator-7f7b754f5d-2kq2c\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.638382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.638275    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a3d90da-0256-4466-ace8-d952fd6d5e09-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7f7b754f5d-2kq2c\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.638382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.638299    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sqk4\" (UniqueName: \"kubernetes.io/projected/8a3d90da-0256-4466-ace8-d952fd6d5e09-kube-api-access-8sqk4\") pod \"data-science-collector-targetallocator-7f7b754f5d-2kq2c\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.638835 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.638812    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a3d90da-0256-4466-ace8-d952fd6d5e09-ta-internal\") pod \"data-science-collector-targetallocator-7f7b754f5d-2kq2c\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.640818 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.640800    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a3d90da-0256-4466-ace8-d952fd6d5e09-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7f7b754f5d-2kq2c\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.700383 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.700318    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sqk4\" (UniqueName: \"kubernetes.io/projected/8a3d90da-0256-4466-ace8-d952fd6d5e09-kube-api-access-8sqk4\") pod \"data-science-collector-targetallocator-7f7b754f5d-2kq2c\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:51.742960 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:51.742934    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:52.114275 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:52.114246    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"]
Oct 30 21:00:52.117962 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:00:52.117933    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a3d90da_0256_4466_ace8_d952fd6d5e09.slice/crio-ae8d84e8b3c0eabd17e47b8a5760ee5dcdb22796c385120cd71000c3c9b8b9ea WatchSource:0}: Error finding container ae8d84e8b3c0eabd17e47b8a5760ee5dcdb22796c385120cd71000c3c9b8b9ea: Status 404 returned error can't find the container with id ae8d84e8b3c0eabd17e47b8a5760ee5dcdb22796c385120cd71000c3c9b8b9ea
Oct 30 21:00:52.120208 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:52.120176    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:00:52.120285 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:52.120232    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:00:52.251583 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:52.251521    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c" event={"ID":"8a3d90da-0256-4466-ace8-d952fd6d5e09","Type":"ContainerStarted","Data":"c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186"}
Oct 30 21:00:52.251583 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:52.251588    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c" event={"ID":"8a3d90da-0256-4466-ace8-d952fd6d5e09","Type":"ContainerStarted","Data":"ae8d84e8b3c0eabd17e47b8a5760ee5dcdb22796c385120cd71000c3c9b8b9ea"}
Oct 30 21:00:52.251824 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:52.251696    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:00:52.252589 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:52.252567    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c" podUID="8a3d90da-0256-4466-ace8-d952fd6d5e09" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.48:8080/readyz\": dial tcp 10.134.0.48:8080: connect: connection refused"
Oct 30 21:00:52.371352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:52.371250    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c" podStartSLOduration=1.3712349640000001 podStartE2EDuration="1.371234964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:00:52.370441901 +0000 UTC m=+1427.326456679" watchObservedRunningTime="2026-10-30 21:00:52.371234964 +0000 UTC m=+1427.327249740"
Oct 30 21:00:53.256371 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:00:53.256336    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c" podUID="8a3d90da-0256-4466-ace8-d952fd6d5e09" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.48:8080/readyz\": dial tcp 10.134.0.48:8080: connect: connection refused"
Oct 30 21:01:03.256958 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.256930    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:01:03.426869 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.426841    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"]
Oct 30 21:01:03.427241 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.427209    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h" podUID="60532b1b-0605-4116-a59d-67d5dde59435" containerName="ta-container" containerID="cri-o://653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5" gracePeriod=30
Oct 30 21:01:03.669847 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.669817    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:01:03.747173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.747150    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/60532b1b-0605-4116-a59d-67d5dde59435-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/60532b1b-0605-4116-a59d-67d5dde59435-data-science-collector-ta-server-cert\") pod \"60532b1b-0605-4116-a59d-67d5dde59435\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") "
Oct 30 21:01:03.747288 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.747189    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/60532b1b-0605-4116-a59d-67d5dde59435-ta-internal\" (UniqueName: \"kubernetes.io/configmap/60532b1b-0605-4116-a59d-67d5dde59435-ta-internal\") pod \"60532b1b-0605-4116-a59d-67d5dde59435\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") "
Oct 30 21:01:03.747288 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.747274    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60532b1b-0605-4116-a59d-67d5dde59435-kube-api-access-kffhp\" (UniqueName: \"kubernetes.io/projected/60532b1b-0605-4116-a59d-67d5dde59435-kube-api-access-kffhp\") pod \"60532b1b-0605-4116-a59d-67d5dde59435\" (UID: \"60532b1b-0605-4116-a59d-67d5dde59435\") "
Oct 30 21:01:03.747625 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.747598    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60532b1b-0605-4116-a59d-67d5dde59435-ta-internal" pod "60532b1b-0605-4116-a59d-67d5dde59435" (UID: "60532b1b-0605-4116-a59d-67d5dde59435"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:03.749423 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.749398    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60532b1b-0605-4116-a59d-67d5dde59435-kube-api-access-kffhp" pod "60532b1b-0605-4116-a59d-67d5dde59435" (UID: "60532b1b-0605-4116-a59d-67d5dde59435"). InnerVolumeSpecName "kube-api-access-kffhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:03.749494 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.749459    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60532b1b-0605-4116-a59d-67d5dde59435-data-science-collector-ta-server-cert" pod "60532b1b-0605-4116-a59d-67d5dde59435" (UID: "60532b1b-0605-4116-a59d-67d5dde59435"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:03.848667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.848553    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kffhp\" (UniqueName: \"kubernetes.io/projected/60532b1b-0605-4116-a59d-67d5dde59435-kube-api-access-kffhp\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:03.848667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.848582    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/60532b1b-0605-4116-a59d-67d5dde59435-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:03.848667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:03.848593    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/60532b1b-0605-4116-a59d-67d5dde59435-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:04.306135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:04.306102    5937 generic.go:356] "Generic (PLEG): container finished" podID="60532b1b-0605-4116-a59d-67d5dde59435" containerID="653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5" exitCode=0
Oct 30 21:01:04.306643 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:04.306150    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"
Oct 30 21:01:04.306643 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:04.306156    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h" event={"ID":"60532b1b-0605-4116-a59d-67d5dde59435","Type":"ContainerDied","Data":"653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5"}
Oct 30 21:01:04.306643 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:04.306185    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h" event={"ID":"60532b1b-0605-4116-a59d-67d5dde59435","Type":"ContainerDied","Data":"0d04ef7764323fffc64e1c9f762e2601ae1bf9e83d1faa36d925c6e3a9d6fde2"}
Oct 30 21:01:04.306643 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:04.306200    5937 scope.go:122] "RemoveContainer" containerID="653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5"
Oct 30 21:01:04.316030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:04.316016    5937 scope.go:122] "RemoveContainer" containerID="653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5"
Oct 30 21:01:04.316279 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:01:04.316260    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5\": container with ID starting with 653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5 not found: ID does not exist" containerID="653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5"
Oct 30 21:01:04.316337 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:04.316285    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5"} err="failed to get container status \"653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5\": rpc error: code = NotFound desc = could not find container \"653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5\": container with ID starting with 653c7eb27069c3e18c10295ae89e333f63a4d49f149cea34835078a09bf8e3d5 not found: ID does not exist"
Oct 30 21:01:04.472046 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:04.472016    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"]
Oct 30 21:01:04.522619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:04.522590    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-745f659767-mqc8h"]
Oct 30 21:01:05.162296 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:05.162266    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60532b1b-0605-4116-a59d-67d5dde59435" path="/var/lib/kubelet/pods/60532b1b-0605-4116-a59d-67d5dde59435/volumes"
Oct 30 21:01:15.673942 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:01:15.673863    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:01:23.321283 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.321249    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"]
Oct 30 21:01:23.323745 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.321650    5937 cpu_manager.go:414] "containerMap: removing container" podUID="60532b1b-0605-4116-a59d-67d5dde59435" containerName="ta-container"
Oct 30 21:01:23.323745 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.321662    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60532b1b-0605-4116-a59d-67d5dde59435" containerName="ta-container"
Oct 30 21:01:23.323745 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.321737    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="60532b1b-0605-4116-a59d-67d5dde59435" containerName="ta-container"
Oct 30 21:01:23.324701 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.324680    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.382464 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.382443    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"]
Oct 30 21:01:23.421186 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.421159    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnz8j\" (UniqueName: \"kubernetes.io/projected/2b974092-e4a6-45c6-8190-c642ff9a7905-kube-api-access-dnz8j\") pod \"data-science-collector-targetallocator-f76ffb789-q9mt8\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.421329 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.421198    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b974092-e4a6-45c6-8190-c642ff9a7905-ta-internal\") pod \"data-science-collector-targetallocator-f76ffb789-q9mt8\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.421395 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.421364    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b974092-e4a6-45c6-8190-c642ff9a7905-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f76ffb789-q9mt8\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.522718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.522697    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b974092-e4a6-45c6-8190-c642ff9a7905-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f76ffb789-q9mt8\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.522830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.522750    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnz8j\" (UniqueName: \"kubernetes.io/projected/2b974092-e4a6-45c6-8190-c642ff9a7905-kube-api-access-dnz8j\") pod \"data-science-collector-targetallocator-f76ffb789-q9mt8\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.522830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.522783    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b974092-e4a6-45c6-8190-c642ff9a7905-ta-internal\") pod \"data-science-collector-targetallocator-f76ffb789-q9mt8\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.523509 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.523446    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b974092-e4a6-45c6-8190-c642ff9a7905-ta-internal\") pod \"data-science-collector-targetallocator-f76ffb789-q9mt8\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.525428 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.525402    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b974092-e4a6-45c6-8190-c642ff9a7905-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f76ffb789-q9mt8\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.585210 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.585159    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnz8j\" (UniqueName: \"kubernetes.io/projected/2b974092-e4a6-45c6-8190-c642ff9a7905-kube-api-access-dnz8j\") pod \"data-science-collector-targetallocator-f76ffb789-q9mt8\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:23.636233 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:23.636214    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:24.007100 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:24.007048    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"]
Oct 30 21:01:24.009516 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:01:24.009492    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b974092_e4a6_45c6_8190_c642ff9a7905.slice/crio-a176420069a08c8a53e4d42469905924282c975dfffbc39f9805069725437f7e WatchSource:0}: Error finding container a176420069a08c8a53e4d42469905924282c975dfffbc39f9805069725437f7e: Status 404 returned error can't find the container with id a176420069a08c8a53e4d42469905924282c975dfffbc39f9805069725437f7e
Oct 30 21:01:24.012124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:24.012093    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:24.012212 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:24.012148    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:24.395908 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:24.395824    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8" event={"ID":"2b974092-e4a6-45c6-8190-c642ff9a7905","Type":"ContainerStarted","Data":"14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177"}
Oct 30 21:01:24.395908 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:24.395871    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:24.395908 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:24.395884    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8" event={"ID":"2b974092-e4a6-45c6-8190-c642ff9a7905","Type":"ContainerStarted","Data":"a176420069a08c8a53e4d42469905924282c975dfffbc39f9805069725437f7e"}
Oct 30 21:01:24.396953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:24.396918    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8" podUID="2b974092-e4a6-45c6-8190-c642ff9a7905" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.49:8080/readyz\": dial tcp 10.134.0.49:8080: connect: connection refused"
Oct 30 21:01:24.515874 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:24.515824    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8" podStartSLOduration=1.515810673 podStartE2EDuration="1.515810673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:24.514642149 +0000 UTC m=+1459.470656925" watchObservedRunningTime="2026-10-30 21:01:24.515810673 +0000 UTC m=+1459.471825445"
Oct 30 21:01:25.401350 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.401319    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:25.572442 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.572408    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"]
Oct 30 21:01:25.572676 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.572653    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c" podUID="8a3d90da-0256-4466-ace8-d952fd6d5e09" containerName="ta-container" containerID="cri-o://c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186" gracePeriod=30
Oct 30 21:01:25.816843 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.816820    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:01:25.943318 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.943242    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a3d90da-0256-4466-ace8-d952fd6d5e09-ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a3d90da-0256-4466-ace8-d952fd6d5e09-ta-internal\") pod \"8a3d90da-0256-4466-ace8-d952fd6d5e09\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") "
Oct 30 21:01:25.943318 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.943305    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8a3d90da-0256-4466-ace8-d952fd6d5e09-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a3d90da-0256-4466-ace8-d952fd6d5e09-data-science-collector-ta-server-cert\") pod \"8a3d90da-0256-4466-ace8-d952fd6d5e09\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") "
Oct 30 21:01:25.943518 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.943332    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a3d90da-0256-4466-ace8-d952fd6d5e09-kube-api-access-8sqk4\" (UniqueName: \"kubernetes.io/projected/8a3d90da-0256-4466-ace8-d952fd6d5e09-kube-api-access-8sqk4\") pod \"8a3d90da-0256-4466-ace8-d952fd6d5e09\" (UID: \"8a3d90da-0256-4466-ace8-d952fd6d5e09\") "
Oct 30 21:01:25.943931 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.943909    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3d90da-0256-4466-ace8-d952fd6d5e09-ta-internal" pod "8a3d90da-0256-4466-ace8-d952fd6d5e09" (UID: "8a3d90da-0256-4466-ace8-d952fd6d5e09"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:25.945769 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.945745    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3d90da-0256-4466-ace8-d952fd6d5e09-kube-api-access-8sqk4" pod "8a3d90da-0256-4466-ace8-d952fd6d5e09" (UID: "8a3d90da-0256-4466-ace8-d952fd6d5e09"). InnerVolumeSpecName "kube-api-access-8sqk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:25.945769 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:25.945751    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3d90da-0256-4466-ace8-d952fd6d5e09-data-science-collector-ta-server-cert" pod "8a3d90da-0256-4466-ace8-d952fd6d5e09" (UID: "8a3d90da-0256-4466-ace8-d952fd6d5e09"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:26.044276 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.044249    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8a3d90da-0256-4466-ace8-d952fd6d5e09-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:26.044276 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.044272    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8a3d90da-0256-4466-ace8-d952fd6d5e09-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:26.044435 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.044285    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sqk4\" (UniqueName: \"kubernetes.io/projected/8a3d90da-0256-4466-ace8-d952fd6d5e09-kube-api-access-8sqk4\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:26.405876 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.405837    5937 generic.go:356] "Generic (PLEG): container finished" podID="8a3d90da-0256-4466-ace8-d952fd6d5e09" containerID="c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186" exitCode=0
Oct 30 21:01:26.406317 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.405881    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"
Oct 30 21:01:26.406317 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.405932    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c" event={"ID":"8a3d90da-0256-4466-ace8-d952fd6d5e09","Type":"ContainerDied","Data":"c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186"}
Oct 30 21:01:26.406317 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.405969    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c" event={"ID":"8a3d90da-0256-4466-ace8-d952fd6d5e09","Type":"ContainerDied","Data":"ae8d84e8b3c0eabd17e47b8a5760ee5dcdb22796c385120cd71000c3c9b8b9ea"}
Oct 30 21:01:26.406317 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.405988    5937 scope.go:122] "RemoveContainer" containerID="c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186"
Oct 30 21:01:26.414856 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.414840    5937 scope.go:122] "RemoveContainer" containerID="c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186"
Oct 30 21:01:26.415114 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:01:26.415095    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186\": container with ID starting with c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186 not found: ID does not exist" containerID="c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186"
Oct 30 21:01:26.415179 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.415122    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186"} err="failed to get container status \"c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186\": rpc error: code = NotFound desc = could not find container \"c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186\": container with ID starting with c5cecb87115bde2ddfae65ba64496e4ed9a0681e80ccf23884fcece8a3b78186 not found: ID does not exist"
Oct 30 21:01:26.573213 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.573183    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"]
Oct 30 21:01:26.623179 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:26.623151    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7f7b754f5d-2kq2c"]
Oct 30 21:01:27.161140 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:27.161106    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a3d90da-0256-4466-ace8-d952fd6d5e09" path="/var/lib/kubelet/pods/8a3d90da-0256-4466-ace8-d952fd6d5e09/volumes"
Oct 30 21:01:45.674281 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:01:45.674231    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:01:54.385907 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.385879    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"]
Oct 30 21:01:54.386418 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.386302    5937 cpu_manager.go:414] "containerMap: removing container" podUID="8a3d90da-0256-4466-ace8-d952fd6d5e09" containerName="ta-container"
Oct 30 21:01:54.386418 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.386314    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a3d90da-0256-4466-ace8-d952fd6d5e09" containerName="ta-container"
Oct 30 21:01:54.386418 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.386367    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a3d90da-0256-4466-ace8-d952fd6d5e09" containerName="ta-container"
Oct 30 21:01:54.389365 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.389346    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.446910 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.446890    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"]
Oct 30 21:01:54.484192 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.484169    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a20899cc-4ff3-40df-86cb-5365516e8f0f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bb956f776-ncl8x\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.484320 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.484212    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc6ll\" (UniqueName: \"kubernetes.io/projected/a20899cc-4ff3-40df-86cb-5365516e8f0f-kube-api-access-dc6ll\") pod \"data-science-collector-targetallocator-5bb956f776-ncl8x\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.484320 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.484284    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a20899cc-4ff3-40df-86cb-5365516e8f0f-ta-internal\") pod \"data-science-collector-targetallocator-5bb956f776-ncl8x\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.585367 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.585336    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a20899cc-4ff3-40df-86cb-5365516e8f0f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bb956f776-ncl8x\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.585557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.585379    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc6ll\" (UniqueName: \"kubernetes.io/projected/a20899cc-4ff3-40df-86cb-5365516e8f0f-kube-api-access-dc6ll\") pod \"data-science-collector-targetallocator-5bb956f776-ncl8x\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.585557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.585413    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a20899cc-4ff3-40df-86cb-5365516e8f0f-ta-internal\") pod \"data-science-collector-targetallocator-5bb956f776-ncl8x\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.586062 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.586042    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a20899cc-4ff3-40df-86cb-5365516e8f0f-ta-internal\") pod \"data-science-collector-targetallocator-5bb956f776-ncl8x\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.587972 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.587952    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a20899cc-4ff3-40df-86cb-5365516e8f0f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5bb956f776-ncl8x\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.647473 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.647413    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc6ll\" (UniqueName: \"kubernetes.io/projected/a20899cc-4ff3-40df-86cb-5365516e8f0f-kube-api-access-dc6ll\") pod \"data-science-collector-targetallocator-5bb956f776-ncl8x\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:54.700566 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:54.700522    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:55.073180 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:55.073156    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"]
Oct 30 21:01:55.075683 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:01:55.075658    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda20899cc_4ff3_40df_86cb_5365516e8f0f.slice/crio-7bb11c531d1fdae115a270aa34f0466afdee06fc55530f20b1b0791244616585 WatchSource:0}: Error finding container 7bb11c531d1fdae115a270aa34f0466afdee06fc55530f20b1b0791244616585: Status 404 returned error can't find the container with id 7bb11c531d1fdae115a270aa34f0466afdee06fc55530f20b1b0791244616585
Oct 30 21:01:55.078026 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:55.077998    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:55.078108 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:55.078049    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:01:55.539286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:55.539251    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x" event={"ID":"a20899cc-4ff3-40df-86cb-5365516e8f0f","Type":"ContainerStarted","Data":"8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02"}
Oct 30 21:01:55.539286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:55.539287    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x" event={"ID":"a20899cc-4ff3-40df-86cb-5365516e8f0f","Type":"ContainerStarted","Data":"7bb11c531d1fdae115a270aa34f0466afdee06fc55530f20b1b0791244616585"}
Oct 30 21:01:55.539742 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:55.539566    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:55.540737 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:55.540715    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x" podUID="a20899cc-4ff3-40df-86cb-5365516e8f0f" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.50:8080/readyz\": dial tcp 10.134.0.50:8080: connect: connection refused"
Oct 30 21:01:55.660761 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:55.660697    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x" podStartSLOduration=1.660680251 podStartE2EDuration="1.660680251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:01:55.65948397 +0000 UTC m=+1490.615498748" watchObservedRunningTime="2026-10-30 21:01:55.660680251 +0000 UTC m=+1490.616695029"
Oct 30 21:01:56.544835 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:56.544810    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:01:56.715587 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:56.715531    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"]
Oct 30 21:01:56.715804 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:56.715776    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8" podUID="2b974092-e4a6-45c6-8190-c642ff9a7905" containerName="ta-container" containerID="cri-o://14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177" gracePeriod=30
Oct 30 21:01:56.961359 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:56.961328    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:57.009375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.009321    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b974092-e4a6-45c6-8190-c642ff9a7905-kube-api-access-dnz8j\" (UniqueName: \"kubernetes.io/projected/2b974092-e4a6-45c6-8190-c642ff9a7905-kube-api-access-dnz8j\") pod \"2b974092-e4a6-45c6-8190-c642ff9a7905\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") "
Oct 30 21:01:57.009612 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.009426    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b974092-e4a6-45c6-8190-c642ff9a7905-ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b974092-e4a6-45c6-8190-c642ff9a7905-ta-internal\") pod \"2b974092-e4a6-45c6-8190-c642ff9a7905\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") "
Oct 30 21:01:57.009612 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.009482    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b974092-e4a6-45c6-8190-c642ff9a7905-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b974092-e4a6-45c6-8190-c642ff9a7905-data-science-collector-ta-server-cert\") pod \"2b974092-e4a6-45c6-8190-c642ff9a7905\" (UID: \"2b974092-e4a6-45c6-8190-c642ff9a7905\") "
Oct 30 21:01:57.009881 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.009855    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b974092-e4a6-45c6-8190-c642ff9a7905-ta-internal" pod "2b974092-e4a6-45c6-8190-c642ff9a7905" (UID: "2b974092-e4a6-45c6-8190-c642ff9a7905"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:01:57.011718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.011692    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b974092-e4a6-45c6-8190-c642ff9a7905-kube-api-access-dnz8j" pod "2b974092-e4a6-45c6-8190-c642ff9a7905" (UID: "2b974092-e4a6-45c6-8190-c642ff9a7905"). InnerVolumeSpecName "kube-api-access-dnz8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:01:57.011944 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.011919    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b974092-e4a6-45c6-8190-c642ff9a7905-data-science-collector-ta-server-cert" pod "2b974092-e4a6-45c6-8190-c642ff9a7905" (UID: "2b974092-e4a6-45c6-8190-c642ff9a7905"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:01:57.111287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.111188    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2b974092-e4a6-45c6-8190-c642ff9a7905-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:57.111287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.111217    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnz8j\" (UniqueName: \"kubernetes.io/projected/2b974092-e4a6-45c6-8190-c642ff9a7905-kube-api-access-dnz8j\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:57.111287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.111230    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2b974092-e4a6-45c6-8190-c642ff9a7905-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:01:57.549566 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.549503    5937 generic.go:356] "Generic (PLEG): container finished" podID="2b974092-e4a6-45c6-8190-c642ff9a7905" containerID="14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177" exitCode=0
Oct 30 21:01:57.550047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.549584    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"
Oct 30 21:01:57.550047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.549596    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8" event={"ID":"2b974092-e4a6-45c6-8190-c642ff9a7905","Type":"ContainerDied","Data":"14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177"}
Oct 30 21:01:57.550047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.549652    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8" event={"ID":"2b974092-e4a6-45c6-8190-c642ff9a7905","Type":"ContainerDied","Data":"a176420069a08c8a53e4d42469905924282c975dfffbc39f9805069725437f7e"}
Oct 30 21:01:57.550047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.549677    5937 scope.go:122] "RemoveContainer" containerID="14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177"
Oct 30 21:01:57.558315 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.558298    5937 scope.go:122] "RemoveContainer" containerID="14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177"
Oct 30 21:01:57.558622 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:01:57.558604    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177\": container with ID starting with 14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177 not found: ID does not exist" containerID="14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177"
Oct 30 21:01:57.558705 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.558628    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177"} err="failed to get container status \"14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177\": rpc error: code = NotFound desc = could not find container \"14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177\": container with ID starting with 14060611b72ad1af8d8150718469f28e758364e7975955e95ce06ad277279177 not found: ID does not exist"
Oct 30 21:01:57.716019 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.715985    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"]
Oct 30 21:01:57.720228 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:57.720206    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f76ffb789-q9mt8"]
Oct 30 21:01:59.160935 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:01:59.160892    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b974092-e4a6-45c6-8190-c642ff9a7905" path="/var/lib/kubelet/pods/2b974092-e4a6-45c6-8190-c642ff9a7905/volumes"
Oct 30 21:02:15.673717 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:02:15.673679    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:02:25.136792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.136759    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 21:02:25.137207 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.137102    5937 cpu_manager.go:414] "containerMap: removing container" podUID="2b974092-e4a6-45c6-8190-c642ff9a7905" containerName="ta-container"
Oct 30 21:02:25.137207 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.137112    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b974092-e4a6-45c6-8190-c642ff9a7905" containerName="ta-container"
Oct 30 21:02:25.137207 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.137197    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b974092-e4a6-45c6-8190-c642ff9a7905" containerName="ta-container"
Oct 30 21:02:25.140104 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.140088    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.244664 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244629    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otlp-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.244884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244685    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otc-internal\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.244884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244714    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-monitoring-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.244884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244719    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:02:25.244884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244778    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b2xx\" (UniqueName: \"kubernetes.io/projected/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-kube-api-access-6b2xx\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.244884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244802    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:02:25.244884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244830    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:02:25.244884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244854    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.244884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244877    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-jqj7h\""
Oct 30 21:02:25.245296 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.244923    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.295146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.295128    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:02:25.295395 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.295383    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:02:25.296662 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.296641    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 21:02:25.346137 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.346117    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otlp-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.346249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.346146    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otc-internal\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.346249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.346164    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-monitoring-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.346249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.346186    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b2xx\" (UniqueName: \"kubernetes.io/projected/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-kube-api-access-6b2xx\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.346249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.346215    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.346435 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.346256    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.347240 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.347214    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otc-internal\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.348972 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.348943    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otlp-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.348972 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.348957    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-monitoring-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.348972 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.348961    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.349125 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.348975    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-tls-certs\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.408429 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.408364    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b2xx\" (UniqueName: \"kubernetes.io/projected/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-kube-api-access-6b2xx\") pod \"data-science-collector-collector-2\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") " pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.452153 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.452129    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:02:25.659740 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.659662    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"]
Oct 30 21:02:25.664048 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.664030    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.721883 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.721856    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"]
Oct 30 21:02:25.749499 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.749473    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtt8g\" (UniqueName: \"kubernetes.io/projected/8302ed42-3476-454b-a2f9-3e39ffd21f85-kube-api-access-gtt8g\") pod \"data-science-collector-targetallocator-648d5c7595-qvrv5\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.749707 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.749689    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8302ed42-3476-454b-a2f9-3e39ffd21f85-ta-internal\") pod \"data-science-collector-targetallocator-648d5c7595-qvrv5\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.749784 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.749721    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8302ed42-3476-454b-a2f9-3e39ffd21f85-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-648d5c7595-qvrv5\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.847955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.847929    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 21:02:25.850154 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.850131    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8302ed42-3476-454b-a2f9-3e39ffd21f85-ta-internal\") pod \"data-science-collector-targetallocator-648d5c7595-qvrv5\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.850278 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.850165    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8302ed42-3476-454b-a2f9-3e39ffd21f85-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-648d5c7595-qvrv5\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.850278 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.850204    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtt8g\" (UniqueName: \"kubernetes.io/projected/8302ed42-3476-454b-a2f9-3e39ffd21f85-kube-api-access-gtt8g\") pod \"data-science-collector-targetallocator-648d5c7595-qvrv5\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.850946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.850917    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8302ed42-3476-454b-a2f9-3e39ffd21f85-ta-internal\") pod \"data-science-collector-targetallocator-648d5c7595-qvrv5\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.853039 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.852970    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8302ed42-3476-454b-a2f9-3e39ffd21f85-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-648d5c7595-qvrv5\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.853585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.853565    5937 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:02:25.913746 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.913693    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtt8g\" (UniqueName: \"kubernetes.io/projected/8302ed42-3476-454b-a2f9-3e39ffd21f85-kube-api-access-gtt8g\") pod \"data-science-collector-targetallocator-648d5c7595-qvrv5\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:25.977133 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:25.977106    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:26.347285 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:26.347261    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"]
Oct 30 21:02:26.349893 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:02:26.349866    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8302ed42_3476_454b_a2f9_3e39ffd21f85.slice/crio-1de28499b5a7f56d287242a0c2e2c5e6c52cc08424db7b8592a94c437f94e3ed WatchSource:0}: Error finding container 1de28499b5a7f56d287242a0c2e2c5e6c52cc08424db7b8592a94c437f94e3ed: Status 404 returned error can't find the container with id 1de28499b5a7f56d287242a0c2e2c5e6c52cc08424db7b8592a94c437f94e3ed
Oct 30 21:02:26.352027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:26.351998    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:02:26.352099 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:26.352080    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:02:26.677763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:26.677669    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab","Type":"ContainerStarted","Data":"f5dba050aa185f2e165f85550d19cf80373210dba8f9268a4b6a5f7559bf5de3"}
Oct 30 21:02:26.679211 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:26.679189    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5" event={"ID":"8302ed42-3476-454b-a2f9-3e39ffd21f85","Type":"ContainerStarted","Data":"04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8"}
Oct 30 21:02:26.679334 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:26.679220    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5" event={"ID":"8302ed42-3476-454b-a2f9-3e39ffd21f85","Type":"ContainerStarted","Data":"1de28499b5a7f56d287242a0c2e2c5e6c52cc08424db7b8592a94c437f94e3ed"}
Oct 30 21:02:26.679403 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:26.679387    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:26.680382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:26.680357    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5" podUID="8302ed42-3476-454b-a2f9-3e39ffd21f85" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.52:8080/readyz\": dial tcp 10.134.0.52:8080: connect: connection refused"
Oct 30 21:02:26.797217 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:26.797152    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5" podStartSLOduration=1.797134447 podStartE2EDuration="1.797134447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:26.796845442 +0000 UTC m=+1521.752860231" watchObservedRunningTime="2026-10-30 21:02:26.797134447 +0000 UTC m=+1521.753149226"
Oct 30 21:02:27.684771 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:27.684748    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:02:27.862135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:27.862100    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"]
Oct 30 21:02:27.862374 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:27.862344    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x" podUID="a20899cc-4ff3-40df-86cb-5365516e8f0f" containerName="ta-container" containerID="cri-o://8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02" gracePeriod=30
Oct 30 21:02:28.106931 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.106902    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:02:28.166733 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.166691    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a20899cc-4ff3-40df-86cb-5365516e8f0f-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a20899cc-4ff3-40df-86cb-5365516e8f0f-data-science-collector-ta-server-cert\") pod \"a20899cc-4ff3-40df-86cb-5365516e8f0f\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") "
Oct 30 21:02:28.166890 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.166743    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a20899cc-4ff3-40df-86cb-5365516e8f0f-kube-api-access-dc6ll\" (UniqueName: \"kubernetes.io/projected/a20899cc-4ff3-40df-86cb-5365516e8f0f-kube-api-access-dc6ll\") pod \"a20899cc-4ff3-40df-86cb-5365516e8f0f\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") "
Oct 30 21:02:28.169222 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.169192    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20899cc-4ff3-40df-86cb-5365516e8f0f-kube-api-access-dc6ll" pod "a20899cc-4ff3-40df-86cb-5365516e8f0f" (UID: "a20899cc-4ff3-40df-86cb-5365516e8f0f"). InnerVolumeSpecName "kube-api-access-dc6ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:02:28.169362 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.169306    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20899cc-4ff3-40df-86cb-5365516e8f0f-data-science-collector-ta-server-cert" pod "a20899cc-4ff3-40df-86cb-5365516e8f0f" (UID: "a20899cc-4ff3-40df-86cb-5365516e8f0f"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:02:28.267653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.267573    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a20899cc-4ff3-40df-86cb-5365516e8f0f-ta-internal\" (UniqueName: \"kubernetes.io/configmap/a20899cc-4ff3-40df-86cb-5365516e8f0f-ta-internal\") pod \"a20899cc-4ff3-40df-86cb-5365516e8f0f\" (UID: \"a20899cc-4ff3-40df-86cb-5365516e8f0f\") "
Oct 30 21:02:28.267909 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.267879    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a20899cc-4ff3-40df-86cb-5365516e8f0f-ta-internal" pod "a20899cc-4ff3-40df-86cb-5365516e8f0f" (UID: "a20899cc-4ff3-40df-86cb-5365516e8f0f"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:02:28.267909 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.267902    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a20899cc-4ff3-40df-86cb-5365516e8f0f-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:28.268032 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.267924    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc6ll\" (UniqueName: \"kubernetes.io/projected/a20899cc-4ff3-40df-86cb-5365516e8f0f-kube-api-access-dc6ll\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:28.369028 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.368996    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a20899cc-4ff3-40df-86cb-5365516e8f0f-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:02:28.690054 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.689405    5937 generic.go:356] "Generic (PLEG): container finished" podID="a20899cc-4ff3-40df-86cb-5365516e8f0f" containerID="8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02" exitCode=0
Oct 30 21:02:28.690054 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.689446    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x" event={"ID":"a20899cc-4ff3-40df-86cb-5365516e8f0f","Type":"ContainerDied","Data":"8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02"}
Oct 30 21:02:28.690054 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.689473    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"
Oct 30 21:02:28.690054 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.689486    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x" event={"ID":"a20899cc-4ff3-40df-86cb-5365516e8f0f","Type":"ContainerDied","Data":"7bb11c531d1fdae115a270aa34f0466afdee06fc55530f20b1b0791244616585"}
Oct 30 21:02:28.690054 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.689506    5937 scope.go:122] "RemoveContainer" containerID="8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02"
Oct 30 21:02:28.699166 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.699052    5937 scope.go:122] "RemoveContainer" containerID="8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02"
Oct 30 21:02:28.699470 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:02:28.699445    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02\": container with ID starting with 8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02 not found: ID does not exist" containerID="8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02"
Oct 30 21:02:28.699585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.699480    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02"} err="failed to get container status \"8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02\": rpc error: code = NotFound desc = could not find container \"8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02\": container with ID starting with 8b55e9b1009ec6f2e324b92c2b43c73470a0e371823ebf9db30cf01da1d07f02 not found: ID does not exist"
Oct 30 21:02:28.857046 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.857003    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"]
Oct 30 21:02:28.860695 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:28.860673    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5bb956f776-ncl8x"]
Oct 30 21:02:29.161162 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:29.161130    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a20899cc-4ff3-40df-86cb-5365516e8f0f" path="/var/lib/kubelet/pods/a20899cc-4ff3-40df-86cb-5365516e8f0f/volumes"
Oct 30 21:02:31.465434 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:31.465406    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:02:31.465710 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:31.465476    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:02:31.709171 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:31.709140    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab","Type":"ContainerStarted","Data":"e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3"}
Oct 30 21:02:31.830295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:31.830198    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-2" podStartSLOduration=1.219422058 podStartE2EDuration="6.830181429s" totalImagesPullingTime="5.610759371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:31.829277015 +0000 UTC m=+1526.785291792" watchObservedRunningTime="2026-10-30 21:02:31.830181429 +0000 UTC m=+1526.786196227"
Oct 30 21:02:45.672175 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:02:45.672099    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:02:58.302039 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:58.302005    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 21:02:58.302433 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:58.302238    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-2" podUID="b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" containerName="otc-container" containerID="cri-o://e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3" gracePeriod=30
Oct 30 21:02:58.962055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:58.962021    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"]
Oct 30 21:02:58.962397 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:58.962385    5937 cpu_manager.go:414] "containerMap: removing container" podUID="a20899cc-4ff3-40df-86cb-5365516e8f0f" containerName="ta-container"
Oct 30 21:02:58.962440 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:58.962398    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a20899cc-4ff3-40df-86cb-5365516e8f0f" containerName="ta-container"
Oct 30 21:02:58.962478 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:58.962466    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="a20899cc-4ff3-40df-86cb-5365516e8f0f" containerName="ta-container"
Oct 30 21:02:58.966315 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:58.966287    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.024124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.024091    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"]
Oct 30 21:02:59.028104 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.028081    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57f685486b-mbcgk\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.028236 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.028158    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-ta-internal\") pod \"data-science-collector-targetallocator-57f685486b-mbcgk\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.028297 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.028230    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2pr6\" (UniqueName: \"kubernetes.io/projected/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-kube-api-access-f2pr6\") pod \"data-science-collector-targetallocator-57f685486b-mbcgk\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.129196 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.129168    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2pr6\" (UniqueName: \"kubernetes.io/projected/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-kube-api-access-f2pr6\") pod \"data-science-collector-targetallocator-57f685486b-mbcgk\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.129345 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.129218    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57f685486b-mbcgk\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.129345 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.129269    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-ta-internal\") pod \"data-science-collector-targetallocator-57f685486b-mbcgk\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.129850 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.129830    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-ta-internal\") pod \"data-science-collector-targetallocator-57f685486b-mbcgk\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.131962 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.131940    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57f685486b-mbcgk\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.191762 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.191735    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2pr6\" (UniqueName: \"kubernetes.io/projected/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-kube-api-access-f2pr6\") pod \"data-science-collector-targetallocator-57f685486b-mbcgk\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.280190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.280119    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.652708 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.652632    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"]
Oct 30 21:02:59.655563 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:02:59.655520    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8ba041b_1b75_4f5e_bf74_5fdf3439b5e4.slice/crio-ab0147e9d35cb96c4ac58c21e25e17e2767a649969523b646e96a898c9f21eca WatchSource:0}: Error finding container ab0147e9d35cb96c4ac58c21e25e17e2767a649969523b646e96a898c9f21eca: Status 404 returned error can't find the container with id ab0147e9d35cb96c4ac58c21e25e17e2767a649969523b646e96a898c9f21eca
Oct 30 21:02:59.657833 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.657804    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:02:59.657904 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.657860    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:02:59.841027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.840986    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk" event={"ID":"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4","Type":"ContainerStarted","Data":"d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb"}
Oct 30 21:02:59.841211 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.841035    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk" event={"ID":"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4","Type":"ContainerStarted","Data":"ab0147e9d35cb96c4ac58c21e25e17e2767a649969523b646e96a898c9f21eca"}
Oct 30 21:02:59.841211 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.841156    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:02:59.842090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.842066    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk" podUID="a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.53:8080/readyz\": dial tcp 10.134.0.53:8080: connect: connection refused"
Oct 30 21:02:59.960802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:02:59.960752    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk" podStartSLOduration=1.960737215 podStartE2EDuration="1.960737215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:02:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:02:59.959799207 +0000 UTC m=+1554.915813981" watchObservedRunningTime="2026-10-30 21:02:59.960737215 +0000 UTC m=+1554.916751991"
Oct 30 21:03:00.648667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.648645    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:03:00.744512 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.744482    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otlp-tls-certs\") pod \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") "
Oct 30 21:03:00.744889 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.744518    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-data-science-collector-ta-client-cert\") pod \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") "
Oct 30 21:03:00.744889 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.744560    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-tls-certs\") pod \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") "
Oct 30 21:03:00.744889 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.744587    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-kube-api-access-6b2xx\" (UniqueName: \"kubernetes.io/projected/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-kube-api-access-6b2xx\") pod \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") "
Oct 30 21:03:00.744889 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.744633    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-monitoring-tls-certs\") pod \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") "
Oct 30 21:03:00.744889 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.744714    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otc-internal\") pod \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\" (UID: \"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab\") "
Oct 30 21:03:00.745221 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.745189    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otc-internal" pod "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" (UID: "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:00.746907 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.746878    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-monitoring-tls-certs" pod "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" (UID: "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:00.747340 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.747315    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-kube-api-access-6b2xx" pod "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" (UID: "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab"). InnerVolumeSpecName "kube-api-access-6b2xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:00.747436 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.747355    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-tls-certs" pod "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" (UID: "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:00.747436 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.747375    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-data-science-collector-ta-client-cert" pod "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" (UID: "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:00.747436 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.747390    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otlp-tls-certs" pod "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" (UID: "b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:00.846049 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.846017    5937 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otlp-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.846049 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.846042    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-data-science-collector-ta-client-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.846049 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.846054    5937 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.846321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.846068    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b2xx\" (UniqueName: \"kubernetes.io/projected/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-kube-api-access-6b2xx\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.846321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.846081    5937 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-monitoring-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.846321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.846089    5937 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab-otc-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:00.847117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.847094    5937 generic.go:356] "Generic (PLEG): container finished" podID="b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" containerID="e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3" exitCode=0
Oct 30 21:03:00.847204 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.847142    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-2"
Oct 30 21:03:00.847242 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.847194    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab","Type":"ContainerDied","Data":"e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3"}
Oct 30 21:03:00.847278 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.847243    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-2" event={"ID":"b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab","Type":"ContainerDied","Data":"f5dba050aa185f2e165f85550d19cf80373210dba8f9268a4b6a5f7559bf5de3"}
Oct 30 21:03:00.847310 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.847273    5937 scope.go:122] "RemoveContainer" containerID="e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3"
Oct 30 21:03:00.847784 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.847763    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk" podUID="a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.53:8080/readyz\": dial tcp 10.134.0.53:8080: connect: connection refused"
Oct 30 21:03:00.856668 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.856650    5937 scope.go:122] "RemoveContainer" containerID="e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3"
Oct 30 21:03:00.856914 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:03:00.856896    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3\": container with ID starting with e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3 not found: ID does not exist" containerID="e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3"
Oct 30 21:03:00.856964 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:00.856922    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3"} err="failed to get container status \"e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3\": rpc error: code = NotFound desc = could not find container \"e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3\": container with ID starting with e835c6d06408e366c3c7ef2d07910c641f50e375f088e181bbab1496bdbf6cf3 not found: ID does not exist"
Oct 30 21:03:01.014173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:01.014102    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 21:03:01.018575 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:01.018530    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-2"]
Oct 30 21:03:01.160940 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:01.160908    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" path="/var/lib/kubelet/pods/b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab/volumes"
Oct 30 21:03:05.397868 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:05.397837    5937 scope.go:122] "RemoveContainer" containerID="dd2408dfb210515f7ba18437cca021f4fde528e75b86baf73ebe2205c3ba1a40"
Oct 30 21:03:10.848573 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:10.848523    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:03:11.018223 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.018189    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"]
Oct 30 21:03:11.018454 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.018423    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5" podUID="8302ed42-3476-454b-a2f9-3e39ffd21f85" containerName="ta-container" containerID="cri-o://04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8" gracePeriod=30
Oct 30 21:03:11.266421 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.266398    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:03:11.340331 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.340306    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8302ed42-3476-454b-a2f9-3e39ffd21f85-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8302ed42-3476-454b-a2f9-3e39ffd21f85-data-science-collector-ta-server-cert\") pod \"8302ed42-3476-454b-a2f9-3e39ffd21f85\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") "
Oct 30 21:03:11.340466 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.340363    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8302ed42-3476-454b-a2f9-3e39ffd21f85-ta-internal\" (UniqueName: \"kubernetes.io/configmap/8302ed42-3476-454b-a2f9-3e39ffd21f85-ta-internal\") pod \"8302ed42-3476-454b-a2f9-3e39ffd21f85\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") "
Oct 30 21:03:11.340466 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.340389    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8302ed42-3476-454b-a2f9-3e39ffd21f85-kube-api-access-gtt8g\" (UniqueName: \"kubernetes.io/projected/8302ed42-3476-454b-a2f9-3e39ffd21f85-kube-api-access-gtt8g\") pod \"8302ed42-3476-454b-a2f9-3e39ffd21f85\" (UID: \"8302ed42-3476-454b-a2f9-3e39ffd21f85\") "
Oct 30 21:03:11.340738 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.340713    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8302ed42-3476-454b-a2f9-3e39ffd21f85-ta-internal" pod "8302ed42-3476-454b-a2f9-3e39ffd21f85" (UID: "8302ed42-3476-454b-a2f9-3e39ffd21f85"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:11.342628 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.342514    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8302ed42-3476-454b-a2f9-3e39ffd21f85-kube-api-access-gtt8g" pod "8302ed42-3476-454b-a2f9-3e39ffd21f85" (UID: "8302ed42-3476-454b-a2f9-3e39ffd21f85"). InnerVolumeSpecName "kube-api-access-gtt8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:11.342628 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.342571    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8302ed42-3476-454b-a2f9-3e39ffd21f85-data-science-collector-ta-server-cert" pod "8302ed42-3476-454b-a2f9-3e39ffd21f85" (UID: "8302ed42-3476-454b-a2f9-3e39ffd21f85"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:11.441926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.441858    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/8302ed42-3476-454b-a2f9-3e39ffd21f85-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:11.441926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.441882    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/8302ed42-3476-454b-a2f9-3e39ffd21f85-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:11.441926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.441892    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtt8g\" (UniqueName: \"kubernetes.io/projected/8302ed42-3476-454b-a2f9-3e39ffd21f85-kube-api-access-gtt8g\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:11.906274 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.906240    5937 generic.go:356] "Generic (PLEG): container finished" podID="8302ed42-3476-454b-a2f9-3e39ffd21f85" containerID="04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8" exitCode=0
Oct 30 21:03:11.906739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.906290    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"
Oct 30 21:03:11.906739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.906309    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5" event={"ID":"8302ed42-3476-454b-a2f9-3e39ffd21f85","Type":"ContainerDied","Data":"04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8"}
Oct 30 21:03:11.906739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.906347    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5" event={"ID":"8302ed42-3476-454b-a2f9-3e39ffd21f85","Type":"ContainerDied","Data":"1de28499b5a7f56d287242a0c2e2c5e6c52cc08424db7b8592a94c437f94e3ed"}
Oct 30 21:03:11.906739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.906371    5937 scope.go:122] "RemoveContainer" containerID="04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8"
Oct 30 21:03:11.914994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.914978    5937 scope.go:122] "RemoveContainer" containerID="04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8"
Oct 30 21:03:11.915292 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:03:11.915273    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8\": container with ID starting with 04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8 not found: ID does not exist" containerID="04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8"
Oct 30 21:03:11.915362 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:11.915299    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8"} err="failed to get container status \"04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8\": rpc error: code = NotFound desc = could not find container \"04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8\": container with ID starting with 04bf29bd526b5cf846ebc5e7ec18550d44c9bf9da1ebcff74073b4dcd8e27aa8 not found: ID does not exist"
Oct 30 21:03:12.072877 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:12.072850    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"]
Oct 30 21:03:12.123594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:12.123561    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-648d5c7595-qvrv5"]
Oct 30 21:03:13.160812 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:13.160780    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8302ed42-3476-454b-a2f9-3e39ffd21f85" path="/var/lib/kubelet/pods/8302ed42-3476-454b-a2f9-3e39ffd21f85/volumes"
Oct 30 21:03:15.671895 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:03:15.671859    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:03:42.067161 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.067131    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"]
Oct 30 21:03:42.067674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.067497    5937 cpu_manager.go:414] "containerMap: removing container" podUID="8302ed42-3476-454b-a2f9-3e39ffd21f85" containerName="ta-container"
Oct 30 21:03:42.067674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.067516    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8302ed42-3476-454b-a2f9-3e39ffd21f85" containerName="ta-container"
Oct 30 21:03:42.067674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.067558    5937 cpu_manager.go:414] "containerMap: removing container" podUID="b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" containerName="otc-container"
Oct 30 21:03:42.067674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.067566    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" containerName="otc-container"
Oct 30 21:03:42.067674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.067631    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="8302ed42-3476-454b-a2f9-3e39ffd21f85" containerName="ta-container"
Oct 30 21:03:42.067674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.067646    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="b1aa1f12-9d7a-4c1b-8f25-abb40286c2ab" containerName="otc-container"
Oct 30 21:03:42.069638 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.069623    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.084631 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.084612    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/58b9ff80-78ea-4e20-9532-5bb6a749f365-ta-internal\") pod \"data-science-collector-targetallocator-748886b84-4l8md\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.084730 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.084670    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxkk5\" (UniqueName: \"kubernetes.io/projected/58b9ff80-78ea-4e20-9532-5bb6a749f365-kube-api-access-fxkk5\") pod \"data-science-collector-targetallocator-748886b84-4l8md\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.084785 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.084766    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/58b9ff80-78ea-4e20-9532-5bb6a749f365-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-748886b84-4l8md\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.143263 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.143232    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"]
Oct 30 21:03:42.185684 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.185659    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/58b9ff80-78ea-4e20-9532-5bb6a749f365-ta-internal\") pod \"data-science-collector-targetallocator-748886b84-4l8md\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.185802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.185717    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxkk5\" (UniqueName: \"kubernetes.io/projected/58b9ff80-78ea-4e20-9532-5bb6a749f365-kube-api-access-fxkk5\") pod \"data-science-collector-targetallocator-748886b84-4l8md\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.185802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.185750    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/58b9ff80-78ea-4e20-9532-5bb6a749f365-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-748886b84-4l8md\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.186258 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.186237    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/58b9ff80-78ea-4e20-9532-5bb6a749f365-ta-internal\") pod \"data-science-collector-targetallocator-748886b84-4l8md\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.188451 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.188426    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/58b9ff80-78ea-4e20-9532-5bb6a749f365-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-748886b84-4l8md\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.247841 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.247818    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxkk5\" (UniqueName: \"kubernetes.io/projected/58b9ff80-78ea-4e20-9532-5bb6a749f365-kube-api-access-fxkk5\") pod \"data-science-collector-targetallocator-748886b84-4l8md\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.380465 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.380405    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:42.754136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.753988    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"]
Oct 30 21:03:42.756461 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:03:42.756437    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58b9ff80_78ea_4e20_9532_5bb6a749f365.slice/crio-95c14b59e6a7c16eb86aef183326bdcf9c58d26d36eea5bad70e7e663d1de4ac WatchSource:0}: Error finding container 95c14b59e6a7c16eb86aef183326bdcf9c58d26d36eea5bad70e7e663d1de4ac: Status 404 returned error can't find the container with id 95c14b59e6a7c16eb86aef183326bdcf9c58d26d36eea5bad70e7e663d1de4ac
Oct 30 21:03:42.758745 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.758713    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:03:42.758832 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:42.758769    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:03:43.046929 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:43.046893    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md" event={"ID":"58b9ff80-78ea-4e20-9532-5bb6a749f365","Type":"ContainerStarted","Data":"902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856"}
Oct 30 21:03:43.046929 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:43.046933    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md" event={"ID":"58b9ff80-78ea-4e20-9532-5bb6a749f365","Type":"ContainerStarted","Data":"95c14b59e6a7c16eb86aef183326bdcf9c58d26d36eea5bad70e7e663d1de4ac"}
Oct 30 21:03:43.047183 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:43.047024    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:43.048045 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:43.048022    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md" podUID="58b9ff80-78ea-4e20-9532-5bb6a749f365" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.54:8080/readyz\": dial tcp 10.134.0.54:8080: connect: connection refused"
Oct 30 21:03:43.167764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:43.167716    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md" podStartSLOduration=1.167701727 podStartE2EDuration="1.167701727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:03:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:03:43.167128861 +0000 UTC m=+1598.123143635" watchObservedRunningTime="2026-10-30 21:03:43.167701727 +0000 UTC m=+1598.123716482"
Oct 30 21:03:44.052965 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.052941    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:44.224255 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.224214    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"]
Oct 30 21:03:44.224737 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.224427    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk" podUID="a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" containerName="ta-container" containerID="cri-o://d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb" gracePeriod=30
Oct 30 21:03:44.470499 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.470477    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:03:44.503830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.503804    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-kube-api-access-f2pr6\" (UniqueName: \"kubernetes.io/projected/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-kube-api-access-f2pr6\") pod \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") "
Oct 30 21:03:44.503947 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.503855    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-data-science-collector-ta-server-cert\") pod \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") "
Oct 30 21:03:44.503947 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.503890    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-ta-internal\") pod \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\" (UID: \"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4\") "
Oct 30 21:03:44.504279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.504258    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-ta-internal" pod "a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" (UID: "a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:44.505968 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.505939    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-data-science-collector-ta-server-cert" pod "a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" (UID: "a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:44.506050 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.505991    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-kube-api-access-f2pr6" pod "a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" (UID: "a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4"). InnerVolumeSpecName "kube-api-access-f2pr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:44.605392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.605318    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.605392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.605355    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:44.605392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:44.605371    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2pr6\" (UniqueName: \"kubernetes.io/projected/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4-kube-api-access-f2pr6\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:45.057293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:45.057261    5937 generic.go:356] "Generic (PLEG): container finished" podID="a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" containerID="d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb" exitCode=0
Oct 30 21:03:45.057453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:45.057304    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"
Oct 30 21:03:45.057453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:45.057345    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk" event={"ID":"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4","Type":"ContainerDied","Data":"d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb"}
Oct 30 21:03:45.057453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:45.057381    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk" event={"ID":"a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4","Type":"ContainerDied","Data":"ab0147e9d35cb96c4ac58c21e25e17e2767a649969523b646e96a898c9f21eca"}
Oct 30 21:03:45.057453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:45.057398    5937 scope.go:122] "RemoveContainer" containerID="d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb"
Oct 30 21:03:45.066571 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:45.066530    5937 scope.go:122] "RemoveContainer" containerID="d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb"
Oct 30 21:03:45.066825 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:03:45.066803    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb\": container with ID starting with d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb not found: ID does not exist" containerID="d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb"
Oct 30 21:03:45.066900 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:45.066834    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb"} err="failed to get container status \"d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb\": rpc error: code = NotFound desc = could not find container \"d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb\": container with ID starting with d14bd069b4537e31f948b801c00451debf6c5a483ad35e01a7bf9ceb8b0eedcb not found: ID does not exist"
Oct 30 21:03:45.228274 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:45.228246    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"]
Oct 30 21:03:45.277869 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:45.277835    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f685486b-mbcgk"]
Oct 30 21:03:45.671357 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:03:45.671316    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:03:47.162082 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:47.162051    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" path="/var/lib/kubelet/pods/a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4/volumes"
Oct 30 21:03:56.841814 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:56.841784    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"]
Oct 30 21:03:56.842274 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:56.842257    5937 cpu_manager.go:414] "containerMap: removing container" podUID="a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" containerName="ta-container"
Oct 30 21:03:56.842324 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:56.842277    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" containerName="ta-container"
Oct 30 21:03:56.842359 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:56.842354    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8ba041b-1b75-4f5e-bf74-5fdf3439b5e4" containerName="ta-container"
Oct 30 21:03:56.844203 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:56.844184    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:56.911943 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:56.911915    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2lz9\" (UniqueName: \"kubernetes.io/projected/bf906eb2-c37c-4626-aa54-731189704aeb-kube-api-access-q2lz9\") pod \"data-science-collector-targetallocator-6b4f78f57d-d4hhk\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:56.912102 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:56.911978    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/bf906eb2-c37c-4626-aa54-731189704aeb-ta-internal\") pod \"data-science-collector-targetallocator-6b4f78f57d-d4hhk\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:56.912102 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:56.912087    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bf906eb2-c37c-4626-aa54-731189704aeb-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b4f78f57d-d4hhk\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:56.950386 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:56.950357    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"]
Oct 30 21:03:57.013347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.013320    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/bf906eb2-c37c-4626-aa54-731189704aeb-ta-internal\") pod \"data-science-collector-targetallocator-6b4f78f57d-d4hhk\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:57.013484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.013375    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bf906eb2-c37c-4626-aa54-731189704aeb-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b4f78f57d-d4hhk\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:57.013484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.013403    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2lz9\" (UniqueName: \"kubernetes.io/projected/bf906eb2-c37c-4626-aa54-731189704aeb-kube-api-access-q2lz9\") pod \"data-science-collector-targetallocator-6b4f78f57d-d4hhk\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:57.014021 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.013998    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/bf906eb2-c37c-4626-aa54-731189704aeb-ta-internal\") pod \"data-science-collector-targetallocator-6b4f78f57d-d4hhk\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:57.020172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.020151    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bf906eb2-c37c-4626-aa54-731189704aeb-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b4f78f57d-d4hhk\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:57.078258 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.078233    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2lz9\" (UniqueName: \"kubernetes.io/projected/bf906eb2-c37c-4626-aa54-731189704aeb-kube-api-access-q2lz9\") pod \"data-science-collector-targetallocator-6b4f78f57d-d4hhk\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:57.155410 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.155323    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:57.526270 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.526250    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"]
Oct 30 21:03:57.529003 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:03:57.528977    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf906eb2_c37c_4626_aa54_731189704aeb.slice/crio-08284dd79ac43737555af7e7ab768b228c500f9d706918db11165656ac321a6c WatchSource:0}: Error finding container 08284dd79ac43737555af7e7ab768b228c500f9d706918db11165656ac321a6c: Status 404 returned error can't find the container with id 08284dd79ac43737555af7e7ab768b228c500f9d706918db11165656ac321a6c
Oct 30 21:03:57.531591 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.531559    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:03:57.531692 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:57.531614    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:03:58.115161 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:58.115124    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk" event={"ID":"bf906eb2-c37c-4626-aa54-731189704aeb","Type":"ContainerStarted","Data":"d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640"}
Oct 30 21:03:58.115645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:58.115175    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk" event={"ID":"bf906eb2-c37c-4626-aa54-731189704aeb","Type":"ContainerStarted","Data":"08284dd79ac43737555af7e7ab768b228c500f9d706918db11165656ac321a6c"}
Oct 30 21:03:58.115645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:58.115419    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:58.116848 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:58.116817    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk" podUID="bf906eb2-c37c-4626-aa54-731189704aeb" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.55:8080/readyz\": dial tcp 10.134.0.55:8080: connect: connection refused"
Oct 30 21:03:58.234822 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:58.234768    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk" podStartSLOduration=2.234756987 podStartE2EDuration="2.234756987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:03:58.234461585 +0000 UTC m=+1613.190476375" watchObservedRunningTime="2026-10-30 21:03:58.234756987 +0000 UTC m=+1613.190771760"
Oct 30 21:03:59.120635 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.120607    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:03:59.291310 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.291278    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"]
Oct 30 21:03:59.291586 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.291557    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md" podUID="58b9ff80-78ea-4e20-9532-5bb6a749f365" containerName="ta-container" containerID="cri-o://902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856" gracePeriod=30
Oct 30 21:03:59.535096 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.535073    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:03:59.636352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.636327    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58b9ff80-78ea-4e20-9532-5bb6a749f365-ta-internal\" (UniqueName: \"kubernetes.io/configmap/58b9ff80-78ea-4e20-9532-5bb6a749f365-ta-internal\") pod \"58b9ff80-78ea-4e20-9532-5bb6a749f365\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") "
Oct 30 21:03:59.636487 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.636398    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58b9ff80-78ea-4e20-9532-5bb6a749f365-kube-api-access-fxkk5\" (UniqueName: \"kubernetes.io/projected/58b9ff80-78ea-4e20-9532-5bb6a749f365-kube-api-access-fxkk5\") pod \"58b9ff80-78ea-4e20-9532-5bb6a749f365\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") "
Oct 30 21:03:59.636487 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.636458    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58b9ff80-78ea-4e20-9532-5bb6a749f365-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/58b9ff80-78ea-4e20-9532-5bb6a749f365-data-science-collector-ta-server-cert\") pod \"58b9ff80-78ea-4e20-9532-5bb6a749f365\" (UID: \"58b9ff80-78ea-4e20-9532-5bb6a749f365\") "
Oct 30 21:03:59.636706 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.636678    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b9ff80-78ea-4e20-9532-5bb6a749f365-ta-internal" pod "58b9ff80-78ea-4e20-9532-5bb6a749f365" (UID: "58b9ff80-78ea-4e20-9532-5bb6a749f365"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:03:59.638632 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.638611    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58b9ff80-78ea-4e20-9532-5bb6a749f365-data-science-collector-ta-server-cert" pod "58b9ff80-78ea-4e20-9532-5bb6a749f365" (UID: "58b9ff80-78ea-4e20-9532-5bb6a749f365"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:03:59.638632 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.638620    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b9ff80-78ea-4e20-9532-5bb6a749f365-kube-api-access-fxkk5" pod "58b9ff80-78ea-4e20-9532-5bb6a749f365" (UID: "58b9ff80-78ea-4e20-9532-5bb6a749f365"). InnerVolumeSpecName "kube-api-access-fxkk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:03:59.737801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.737775    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/58b9ff80-78ea-4e20-9532-5bb6a749f365-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:59.737801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.737801    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/58b9ff80-78ea-4e20-9532-5bb6a749f365-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:03:59.737990 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:03:59.737815    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxkk5\" (UniqueName: \"kubernetes.io/projected/58b9ff80-78ea-4e20-9532-5bb6a749f365-kube-api-access-fxkk5\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:04:00.125206 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:00.125126    5937 generic.go:356] "Generic (PLEG): container finished" podID="58b9ff80-78ea-4e20-9532-5bb6a749f365" containerID="902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856" exitCode=0
Oct 30 21:04:00.125206 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:00.125170    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"
Oct 30 21:04:00.125700 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:00.125217    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md" event={"ID":"58b9ff80-78ea-4e20-9532-5bb6a749f365","Type":"ContainerDied","Data":"902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856"}
Oct 30 21:04:00.125700 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:00.125263    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md" event={"ID":"58b9ff80-78ea-4e20-9532-5bb6a749f365","Type":"ContainerDied","Data":"95c14b59e6a7c16eb86aef183326bdcf9c58d26d36eea5bad70e7e663d1de4ac"}
Oct 30 21:04:00.125700 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:00.125284    5937 scope.go:122] "RemoveContainer" containerID="902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856"
Oct 30 21:04:00.134382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:00.134361    5937 scope.go:122] "RemoveContainer" containerID="902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856"
Oct 30 21:04:00.134658 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:04:00.134640    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856\": container with ID starting with 902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856 not found: ID does not exist" containerID="902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856"
Oct 30 21:04:00.134714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:00.134666    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856"} err="failed to get container status \"902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856\": rpc error: code = NotFound desc = could not find container \"902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856\": container with ID starting with 902e51e7e09e0dc2981c2ab7c505e0d28735cd42214c35bea962de67acb8c856 not found: ID does not exist"
Oct 30 21:04:00.292494 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:00.292469    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"]
Oct 30 21:04:00.343358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:00.343334    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-748886b84-4l8md"]
Oct 30 21:04:01.160415 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:04:01.160384    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58b9ff80-78ea-4e20-9532-5bb6a749f365" path="/var/lib/kubelet/pods/58b9ff80-78ea-4e20-9532-5bb6a749f365/volumes"
Oct 30 21:04:15.671308 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:04:15.671224    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:04:45.671071 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:04:45.671032    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:05:06.655619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.655590    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"]
Oct 30 21:05:06.656132 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.656111    5937 cpu_manager.go:414] "containerMap: removing container" podUID="58b9ff80-78ea-4e20-9532-5bb6a749f365" containerName="ta-container"
Oct 30 21:05:06.656212 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.656136    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58b9ff80-78ea-4e20-9532-5bb6a749f365" containerName="ta-container"
Oct 30 21:05:06.656293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.656279    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="58b9ff80-78ea-4e20-9532-5bb6a749f365" containerName="ta-container"
Oct 30 21:05:06.658197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.658174    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:06.721930 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.721889    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"]
Oct 30 21:05:06.823218 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.823177    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5aebd2ad-62d6-4276-a410-349e9ba5fc71-ta-internal\") pod \"data-science-collector-targetallocator-5659b57c9c-mj8l8\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:06.823218 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.823230    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5aebd2ad-62d6-4276-a410-349e9ba5fc71-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5659b57c9c-mj8l8\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:06.823462 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.823358    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq92c\" (UniqueName: \"kubernetes.io/projected/5aebd2ad-62d6-4276-a410-349e9ba5fc71-kube-api-access-hq92c\") pod \"data-science-collector-targetallocator-5659b57c9c-mj8l8\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:06.924485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.924395    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5aebd2ad-62d6-4276-a410-349e9ba5fc71-ta-internal\") pod \"data-science-collector-targetallocator-5659b57c9c-mj8l8\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:06.924485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.924443    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5aebd2ad-62d6-4276-a410-349e9ba5fc71-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5659b57c9c-mj8l8\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:06.924709 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.924507    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq92c\" (UniqueName: \"kubernetes.io/projected/5aebd2ad-62d6-4276-a410-349e9ba5fc71-kube-api-access-hq92c\") pod \"data-science-collector-targetallocator-5659b57c9c-mj8l8\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:06.925090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.925069    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5aebd2ad-62d6-4276-a410-349e9ba5fc71-ta-internal\") pod \"data-science-collector-targetallocator-5659b57c9c-mj8l8\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:06.927038 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.927018    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5aebd2ad-62d6-4276-a410-349e9ba5fc71-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5659b57c9c-mj8l8\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:06.988288 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:06.988257    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq92c\" (UniqueName: \"kubernetes.io/projected/5aebd2ad-62d6-4276-a410-349e9ba5fc71-kube-api-access-hq92c\") pod \"data-science-collector-targetallocator-5659b57c9c-mj8l8\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:07.268215 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:07.268185    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:07.636770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:07.636744    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"]
Oct 30 21:05:07.639333 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:05:07.639303    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5aebd2ad_62d6_4276_a410_349e9ba5fc71.slice/crio-04ae36d4557233053e6edde3c0fcda3493a0135147c5620ca34d3563c64bf3f7 WatchSource:0}: Error finding container 04ae36d4557233053e6edde3c0fcda3493a0135147c5620ca34d3563c64bf3f7: Status 404 returned error can't find the container with id 04ae36d4557233053e6edde3c0fcda3493a0135147c5620ca34d3563c64bf3f7
Oct 30 21:05:07.641582 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:07.641522    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:05:07.641668 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:07.641618    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:05:08.426946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:08.426914    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8" event={"ID":"5aebd2ad-62d6-4276-a410-349e9ba5fc71","Type":"ContainerStarted","Data":"c053ae0505b4d5b61f41e2740faae5858350b64d63e0f6c52714880dc56f5f5a"}
Oct 30 21:05:08.426946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:08.426953    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8" event={"ID":"5aebd2ad-62d6-4276-a410-349e9ba5fc71","Type":"ContainerStarted","Data":"04ae36d4557233053e6edde3c0fcda3493a0135147c5620ca34d3563c64bf3f7"}
Oct 30 21:05:08.427378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:08.427069    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:08.428285 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:08.428258    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8" podUID="5aebd2ad-62d6-4276-a410-349e9ba5fc71" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.56:8080/readyz\": dial tcp 10.134.0.56:8080: connect: connection refused"
Oct 30 21:05:08.545941 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:08.545896    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8" podStartSLOduration=2.545881315 podStartE2EDuration="2.545881315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:05:08.545672327 +0000 UTC m=+1683.501687107" watchObservedRunningTime="2026-10-30 21:05:08.545881315 +0000 UTC m=+1683.501896090"
Oct 30 21:05:09.432294 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.432267    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:09.603170 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.603121    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"]
Oct 30 21:05:09.603358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.603331    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk" podUID="bf906eb2-c37c-4626-aa54-731189704aeb" containerName="ta-container" containerID="cri-o://d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640" gracePeriod=30
Oct 30 21:05:09.851683 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.851661    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:05:09.952408 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.952377    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bf906eb2-c37c-4626-aa54-731189704aeb-ta-internal\" (UniqueName: \"kubernetes.io/configmap/bf906eb2-c37c-4626-aa54-731189704aeb-ta-internal\") pod \"bf906eb2-c37c-4626-aa54-731189704aeb\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") "
Oct 30 21:05:09.952580 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.952447    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf906eb2-c37c-4626-aa54-731189704aeb-kube-api-access-q2lz9\" (UniqueName: \"kubernetes.io/projected/bf906eb2-c37c-4626-aa54-731189704aeb-kube-api-access-q2lz9\") pod \"bf906eb2-c37c-4626-aa54-731189704aeb\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") "
Oct 30 21:05:09.952580 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.952477    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bf906eb2-c37c-4626-aa54-731189704aeb-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bf906eb2-c37c-4626-aa54-731189704aeb-data-science-collector-ta-server-cert\") pod \"bf906eb2-c37c-4626-aa54-731189704aeb\" (UID: \"bf906eb2-c37c-4626-aa54-731189704aeb\") "
Oct 30 21:05:09.952806 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.952790    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf906eb2-c37c-4626-aa54-731189704aeb-ta-internal" pod "bf906eb2-c37c-4626-aa54-731189704aeb" (UID: "bf906eb2-c37c-4626-aa54-731189704aeb"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:05:09.954693 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.954668    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf906eb2-c37c-4626-aa54-731189704aeb-data-science-collector-ta-server-cert" pod "bf906eb2-c37c-4626-aa54-731189704aeb" (UID: "bf906eb2-c37c-4626-aa54-731189704aeb"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:09.954801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:09.954690    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf906eb2-c37c-4626-aa54-731189704aeb-kube-api-access-q2lz9" pod "bf906eb2-c37c-4626-aa54-731189704aeb" (UID: "bf906eb2-c37c-4626-aa54-731189704aeb"). InnerVolumeSpecName "kube-api-access-q2lz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:10.053619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.053548    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2lz9\" (UniqueName: \"kubernetes.io/projected/bf906eb2-c37c-4626-aa54-731189704aeb-kube-api-access-q2lz9\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:10.053619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.053571    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/bf906eb2-c37c-4626-aa54-731189704aeb-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:10.053619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.053582    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/bf906eb2-c37c-4626-aa54-731189704aeb-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:10.436926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.436852    5937 generic.go:356] "Generic (PLEG): container finished" podID="bf906eb2-c37c-4626-aa54-731189704aeb" containerID="d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640" exitCode=0
Oct 30 21:05:10.436926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.436891    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"
Oct 30 21:05:10.437368 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.436929    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk" event={"ID":"bf906eb2-c37c-4626-aa54-731189704aeb","Type":"ContainerDied","Data":"d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640"}
Oct 30 21:05:10.437368 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.436967    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk" event={"ID":"bf906eb2-c37c-4626-aa54-731189704aeb","Type":"ContainerDied","Data":"08284dd79ac43737555af7e7ab768b228c500f9d706918db11165656ac321a6c"}
Oct 30 21:05:10.437368 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.436987    5937 scope.go:122] "RemoveContainer" containerID="d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640"
Oct 30 21:05:10.445456 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.445440    5937 scope.go:122] "RemoveContainer" containerID="d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640"
Oct 30 21:05:10.445763 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:05:10.445745    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640\": container with ID starting with d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640 not found: ID does not exist" containerID="d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640"
Oct 30 21:05:10.445823 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.445771    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640"} err="failed to get container status \"d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640\": rpc error: code = NotFound desc = could not find container \"d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640\": container with ID starting with d19158fcac1e350b185db0fe1eae15866476e3647bbacb2da71f015a51716640 not found: ID does not exist"
Oct 30 21:05:10.603469 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.603441    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"]
Oct 30 21:05:10.609978 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:10.609951    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b4f78f57d-d4hhk"]
Oct 30 21:05:11.160416 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:11.160386    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bf906eb2-c37c-4626-aa54-731189704aeb" path="/var/lib/kubelet/pods/bf906eb2-c37c-4626-aa54-731189704aeb/volumes"
Oct 30 21:05:15.671860 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:05:15.671824    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:05:20.185325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.185291    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"]
Oct 30 21:05:20.185729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.185684    5937 cpu_manager.go:414] "containerMap: removing container" podUID="bf906eb2-c37c-4626-aa54-731189704aeb" containerName="ta-container"
Oct 30 21:05:20.185729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.185696    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf906eb2-c37c-4626-aa54-731189704aeb" containerName="ta-container"
Oct 30 21:05:20.185811 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.185761    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="bf906eb2-c37c-4626-aa54-731189704aeb" containerName="ta-container"
Oct 30 21:05:20.190196 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.190181    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.239952 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.239929    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f726c8fd-f24c-4243-93da-b0de080dfe8b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-86d45c7dff-bcfsd\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.240089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.239983    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f726c8fd-f24c-4243-93da-b0de080dfe8b-ta-internal\") pod \"data-science-collector-targetallocator-86d45c7dff-bcfsd\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.240089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.240003    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crfcg\" (UniqueName: \"kubernetes.io/projected/f726c8fd-f24c-4243-93da-b0de080dfe8b-kube-api-access-crfcg\") pod \"data-science-collector-targetallocator-86d45c7dff-bcfsd\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.248009 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.247987    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"]
Oct 30 21:05:20.341456 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.341419    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f726c8fd-f24c-4243-93da-b0de080dfe8b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-86d45c7dff-bcfsd\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.341638 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.341492    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f726c8fd-f24c-4243-93da-b0de080dfe8b-ta-internal\") pod \"data-science-collector-targetallocator-86d45c7dff-bcfsd\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.341638 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.341515    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crfcg\" (UniqueName: \"kubernetes.io/projected/f726c8fd-f24c-4243-93da-b0de080dfe8b-kube-api-access-crfcg\") pod \"data-science-collector-targetallocator-86d45c7dff-bcfsd\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.342190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.342162    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f726c8fd-f24c-4243-93da-b0de080dfe8b-ta-internal\") pod \"data-science-collector-targetallocator-86d45c7dff-bcfsd\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.343970 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.343945    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f726c8fd-f24c-4243-93da-b0de080dfe8b-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-86d45c7dff-bcfsd\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.403834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.403807    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crfcg\" (UniqueName: \"kubernetes.io/projected/f726c8fd-f24c-4243-93da-b0de080dfe8b-kube-api-access-crfcg\") pod \"data-science-collector-targetallocator-86d45c7dff-bcfsd\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.501174 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.501147    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:20.879927 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.879851    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"]
Oct 30 21:05:20.882772 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:05:20.882744    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf726c8fd_f24c_4243_93da_b0de080dfe8b.slice/crio-093ffc1bd8624866465898598744b6ce375c1659dc5fe55ff093133c556ba143 WatchSource:0}: Error finding container 093ffc1bd8624866465898598744b6ce375c1659dc5fe55ff093133c556ba143: Status 404 returned error can't find the container with id 093ffc1bd8624866465898598744b6ce375c1659dc5fe55ff093133c556ba143
Oct 30 21:05:20.885004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.884974    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:05:20.885084 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:20.885043    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:05:21.490262 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:21.490227    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd" event={"ID":"f726c8fd-f24c-4243-93da-b0de080dfe8b","Type":"ContainerStarted","Data":"8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6"}
Oct 30 21:05:21.490262 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:21.490269    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd" event={"ID":"f726c8fd-f24c-4243-93da-b0de080dfe8b","Type":"ContainerStarted","Data":"093ffc1bd8624866465898598744b6ce375c1659dc5fe55ff093133c556ba143"}
Oct 30 21:05:21.490749 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:21.490374    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:21.491622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:21.491597    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd" podUID="f726c8fd-f24c-4243-93da-b0de080dfe8b" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.57:8080/readyz\": dial tcp 10.134.0.57:8080: connect: connection refused"
Oct 30 21:05:22.495200 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:22.495171    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:22.614392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:22.614345    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd" podStartSLOduration=2.614331127 podStartE2EDuration="2.614331127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:05:21.608374652 +0000 UTC m=+1696.564389450" watchObservedRunningTime="2026-10-30 21:05:22.614331127 +0000 UTC m=+1697.570345897"
Oct 30 21:05:22.665111 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:22.665072    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"]
Oct 30 21:05:22.665286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:22.665269    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8" podUID="5aebd2ad-62d6-4276-a410-349e9ba5fc71" containerName="ta-container" containerID="cri-o://c053ae0505b4d5b61f41e2740faae5858350b64d63e0f6c52714880dc56f5f5a" gracePeriod=30
Oct 30 21:05:27.517423 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.517393    5937 generic.go:356] "Generic (PLEG): container finished" podID="5aebd2ad-62d6-4276-a410-349e9ba5fc71" containerID="c053ae0505b4d5b61f41e2740faae5858350b64d63e0f6c52714880dc56f5f5a" exitCode=0
Oct 30 21:05:27.517785 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.517447    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8" event={"ID":"5aebd2ad-62d6-4276-a410-349e9ba5fc71","Type":"ContainerDied","Data":"c053ae0505b4d5b61f41e2740faae5858350b64d63e0f6c52714880dc56f5f5a"}
Oct 30 21:05:27.614955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.614929    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:27.705161 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.705129    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5aebd2ad-62d6-4276-a410-349e9ba5fc71-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5aebd2ad-62d6-4276-a410-349e9ba5fc71-data-science-collector-ta-server-cert\") pod \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") "
Oct 30 21:05:27.705299 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.705194    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5aebd2ad-62d6-4276-a410-349e9ba5fc71-kube-api-access-hq92c\" (UniqueName: \"kubernetes.io/projected/5aebd2ad-62d6-4276-a410-349e9ba5fc71-kube-api-access-hq92c\") pod \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") "
Oct 30 21:05:27.705299 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.705236    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5aebd2ad-62d6-4276-a410-349e9ba5fc71-ta-internal\" (UniqueName: \"kubernetes.io/configmap/5aebd2ad-62d6-4276-a410-349e9ba5fc71-ta-internal\") pod \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\" (UID: \"5aebd2ad-62d6-4276-a410-349e9ba5fc71\") "
Oct 30 21:05:27.705638 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.705609    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aebd2ad-62d6-4276-a410-349e9ba5fc71-ta-internal" pod "5aebd2ad-62d6-4276-a410-349e9ba5fc71" (UID: "5aebd2ad-62d6-4276-a410-349e9ba5fc71"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:05:27.707359 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.707336    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aebd2ad-62d6-4276-a410-349e9ba5fc71-kube-api-access-hq92c" pod "5aebd2ad-62d6-4276-a410-349e9ba5fc71" (UID: "5aebd2ad-62d6-4276-a410-349e9ba5fc71"). InnerVolumeSpecName "kube-api-access-hq92c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:27.707454 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.707391    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aebd2ad-62d6-4276-a410-349e9ba5fc71-data-science-collector-ta-server-cert" pod "5aebd2ad-62d6-4276-a410-349e9ba5fc71" (UID: "5aebd2ad-62d6-4276-a410-349e9ba5fc71"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:27.806084 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.806056    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq92c\" (UniqueName: \"kubernetes.io/projected/5aebd2ad-62d6-4276-a410-349e9ba5fc71-kube-api-access-hq92c\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:27.806084 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.806082    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5aebd2ad-62d6-4276-a410-349e9ba5fc71-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:27.806084 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:27.806091    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5aebd2ad-62d6-4276-a410-349e9ba5fc71-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:28.523325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:28.523298    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"
Oct 30 21:05:28.523325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:28.523303    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8" event={"ID":"5aebd2ad-62d6-4276-a410-349e9ba5fc71","Type":"ContainerDied","Data":"04ae36d4557233053e6edde3c0fcda3493a0135147c5620ca34d3563c64bf3f7"}
Oct 30 21:05:28.523842 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:28.523355    5937 scope.go:122] "RemoveContainer" containerID="c053ae0505b4d5b61f41e2740faae5858350b64d63e0f6c52714880dc56f5f5a"
Oct 30 21:05:28.691121 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:28.691093    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"]
Oct 30 21:05:28.741816 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:28.741790    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5659b57c9c-mj8l8"]
Oct 30 21:05:29.161114 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:29.161080    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5aebd2ad-62d6-4276-a410-349e9ba5fc71" path="/var/lib/kubelet/pods/5aebd2ad-62d6-4276-a410-349e9ba5fc71/volumes"
Oct 30 21:05:37.537958 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.537928    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"]
Oct 30 21:05:37.538349 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.538274    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5aebd2ad-62d6-4276-a410-349e9ba5fc71" containerName="ta-container"
Oct 30 21:05:37.538349 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.538284    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5aebd2ad-62d6-4276-a410-349e9ba5fc71" containerName="ta-container"
Oct 30 21:05:37.538427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.538354    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5aebd2ad-62d6-4276-a410-349e9ba5fc71" containerName="ta-container"
Oct 30 21:05:37.542842 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.542820    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.592554 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.592511    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1b1bb2b8-89bd-49ee-8caf-686135eb164f-ta-internal\") pod \"data-science-collector-targetallocator-7b9f4dbb6c-fxdln\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.592732 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.592582    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1b1bb2b8-89bd-49ee-8caf-686135eb164f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7b9f4dbb6c-fxdln\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.592732 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.592686    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm9cc\" (UniqueName: \"kubernetes.io/projected/1b1bb2b8-89bd-49ee-8caf-686135eb164f-kube-api-access-rm9cc\") pod \"data-science-collector-targetallocator-7b9f4dbb6c-fxdln\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.599073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.599047    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"]
Oct 30 21:05:37.694191 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.694155    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1b1bb2b8-89bd-49ee-8caf-686135eb164f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7b9f4dbb6c-fxdln\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.694373 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.694228    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm9cc\" (UniqueName: \"kubernetes.io/projected/1b1bb2b8-89bd-49ee-8caf-686135eb164f-kube-api-access-rm9cc\") pod \"data-science-collector-targetallocator-7b9f4dbb6c-fxdln\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.694373 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.694273    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1b1bb2b8-89bd-49ee-8caf-686135eb164f-ta-internal\") pod \"data-science-collector-targetallocator-7b9f4dbb6c-fxdln\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.694969 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.694948    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1b1bb2b8-89bd-49ee-8caf-686135eb164f-ta-internal\") pod \"data-science-collector-targetallocator-7b9f4dbb6c-fxdln\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.696771 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.696750    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1b1bb2b8-89bd-49ee-8caf-686135eb164f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7b9f4dbb6c-fxdln\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.756456 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.756426    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm9cc\" (UniqueName: \"kubernetes.io/projected/1b1bb2b8-89bd-49ee-8caf-686135eb164f-kube-api-access-rm9cc\") pod \"data-science-collector-targetallocator-7b9f4dbb6c-fxdln\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:37.854586 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:37.854490    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:38.060205 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.060174    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"]
Oct 30 21:05:38.230875 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.230853    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"]
Oct 30 21:05:38.233452 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:05:38.233425    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b1bb2b8_89bd_49ee_8caf_686135eb164f.slice/crio-7148c6a4d3f8b54f1b6d571fd6ba07b273a37365ab72606b8c9a1561724cee9c WatchSource:0}: Error finding container 7148c6a4d3f8b54f1b6d571fd6ba07b273a37365ab72606b8c9a1561724cee9c: Status 404 returned error can't find the container with id 7148c6a4d3f8b54f1b6d571fd6ba07b273a37365ab72606b8c9a1561724cee9c
Oct 30 21:05:38.236012 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.235981    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:05:38.236090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.236037    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:05:38.571753 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.571667    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln" event={"ID":"1b1bb2b8-89bd-49ee-8caf-686135eb164f","Type":"ContainerStarted","Data":"29e4c27d1d9899bc218298faf59e59177910a5de3204b44c600ce9fb6a92e737"}
Oct 30 21:05:38.571753 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.571711    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln" event={"ID":"1b1bb2b8-89bd-49ee-8caf-686135eb164f","Type":"ContainerStarted","Data":"7148c6a4d3f8b54f1b6d571fd6ba07b273a37365ab72606b8c9a1561724cee9c"}
Oct 30 21:05:38.571753 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.571726    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln" podUID="1b1bb2b8-89bd-49ee-8caf-686135eb164f" containerName="ta-container" containerID="cri-o://29e4c27d1d9899bc218298faf59e59177910a5de3204b44c600ce9fb6a92e737" gracePeriod=30
Oct 30 21:05:38.572249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.571821    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:38.573170 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.573143    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln" podUID="1b1bb2b8-89bd-49ee-8caf-686135eb164f" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.58:8080/readyz\": dial tcp 10.134.0.58:8080: connect: connection refused"
Oct 30 21:05:38.690791 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:38.690735    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln" podStartSLOduration=1.690721385 podStartE2EDuration="1.690721385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:05:38.689842751 +0000 UTC m=+1713.645857528" watchObservedRunningTime="2026-10-30 21:05:38.690721385 +0000 UTC m=+1713.646736161"
Oct 30 21:05:39.578020 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.577989    5937 generic.go:356] "Generic (PLEG): container finished" podID="1b1bb2b8-89bd-49ee-8caf-686135eb164f" containerID="29e4c27d1d9899bc218298faf59e59177910a5de3204b44c600ce9fb6a92e737" exitCode=0
Oct 30 21:05:39.578397 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.578053    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln" event={"ID":"1b1bb2b8-89bd-49ee-8caf-686135eb164f","Type":"ContainerDied","Data":"29e4c27d1d9899bc218298faf59e59177910a5de3204b44c600ce9fb6a92e737"}
Oct 30 21:05:39.638620 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.638594    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:39.711310 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.711278    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1b1bb2b8-89bd-49ee-8caf-686135eb164f-ta-internal\" (UniqueName: \"kubernetes.io/configmap/1b1bb2b8-89bd-49ee-8caf-686135eb164f-ta-internal\") pod \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") "
Oct 30 21:05:39.711470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.711331    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1b1bb2b8-89bd-49ee-8caf-686135eb164f-kube-api-access-rm9cc\" (UniqueName: \"kubernetes.io/projected/1b1bb2b8-89bd-49ee-8caf-686135eb164f-kube-api-access-rm9cc\") pod \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") "
Oct 30 21:05:39.711470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.711373    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1b1bb2b8-89bd-49ee-8caf-686135eb164f-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1b1bb2b8-89bd-49ee-8caf-686135eb164f-data-science-collector-ta-server-cert\") pod \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\" (UID: \"1b1bb2b8-89bd-49ee-8caf-686135eb164f\") "
Oct 30 21:05:39.711757 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.711727    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b1bb2b8-89bd-49ee-8caf-686135eb164f-ta-internal" pod "1b1bb2b8-89bd-49ee-8caf-686135eb164f" (UID: "1b1bb2b8-89bd-49ee-8caf-686135eb164f"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:05:39.713650 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.713630    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b1bb2b8-89bd-49ee-8caf-686135eb164f-kube-api-access-rm9cc" pod "1b1bb2b8-89bd-49ee-8caf-686135eb164f" (UID: "1b1bb2b8-89bd-49ee-8caf-686135eb164f"). InnerVolumeSpecName "kube-api-access-rm9cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:39.713719 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.713656    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b1bb2b8-89bd-49ee-8caf-686135eb164f-data-science-collector-ta-server-cert" pod "1b1bb2b8-89bd-49ee-8caf-686135eb164f" (UID: "1b1bb2b8-89bd-49ee-8caf-686135eb164f"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:39.812796 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.812759    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1b1bb2b8-89bd-49ee-8caf-686135eb164f-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:39.812796 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.812786    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1b1bb2b8-89bd-49ee-8caf-686135eb164f-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:39.812796 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:39.812799    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm9cc\" (UniqueName: \"kubernetes.io/projected/1b1bb2b8-89bd-49ee-8caf-686135eb164f-kube-api-access-rm9cc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:40.583580 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:40.583529    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln" event={"ID":"1b1bb2b8-89bd-49ee-8caf-686135eb164f","Type":"ContainerDied","Data":"7148c6a4d3f8b54f1b6d571fd6ba07b273a37365ab72606b8c9a1561724cee9c"}
Oct 30 21:05:40.584029 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:40.583594    5937 scope.go:122] "RemoveContainer" containerID="29e4c27d1d9899bc218298faf59e59177910a5de3204b44c600ce9fb6a92e737"
Oct 30 21:05:40.584029 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:40.583557    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"
Oct 30 21:05:40.752153 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:40.752117    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"]
Oct 30 21:05:40.802727 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:40.802696    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b9f4dbb6c-fxdln"]
Oct 30 21:05:41.161204 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:41.161173    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1b1bb2b8-89bd-49ee-8caf-686135eb164f" path="/var/lib/kubelet/pods/1b1bb2b8-89bd-49ee-8caf-686135eb164f/volumes"
Oct 30 21:05:45.627273 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:45.627192    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"]
Oct 30 21:05:45.627772 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:45.627450    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd" podUID="f726c8fd-f24c-4243-93da-b0de080dfe8b" containerName="ta-container" containerID="cri-o://8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6" gracePeriod=30
Oct 30 21:05:45.673618 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:05:45.673583    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:05:45.867256 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:45.867236    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:45.970161 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:45.970138    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f726c8fd-f24c-4243-93da-b0de080dfe8b-ta-internal\" (UniqueName: \"kubernetes.io/configmap/f726c8fd-f24c-4243-93da-b0de080dfe8b-ta-internal\") pod \"f726c8fd-f24c-4243-93da-b0de080dfe8b\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") "
Oct 30 21:05:45.970320 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:45.970168    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f726c8fd-f24c-4243-93da-b0de080dfe8b-kube-api-access-crfcg\" (UniqueName: \"kubernetes.io/projected/f726c8fd-f24c-4243-93da-b0de080dfe8b-kube-api-access-crfcg\") pod \"f726c8fd-f24c-4243-93da-b0de080dfe8b\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") "
Oct 30 21:05:45.970320 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:45.970246    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f726c8fd-f24c-4243-93da-b0de080dfe8b-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f726c8fd-f24c-4243-93da-b0de080dfe8b-data-science-collector-ta-server-cert\") pod \"f726c8fd-f24c-4243-93da-b0de080dfe8b\" (UID: \"f726c8fd-f24c-4243-93da-b0de080dfe8b\") "
Oct 30 21:05:45.970484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:45.970463    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f726c8fd-f24c-4243-93da-b0de080dfe8b-ta-internal" pod "f726c8fd-f24c-4243-93da-b0de080dfe8b" (UID: "f726c8fd-f24c-4243-93da-b0de080dfe8b"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:05:45.972572 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:45.972502    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f726c8fd-f24c-4243-93da-b0de080dfe8b-data-science-collector-ta-server-cert" pod "f726c8fd-f24c-4243-93da-b0de080dfe8b" (UID: "f726c8fd-f24c-4243-93da-b0de080dfe8b"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:05:45.972572 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:45.972521    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f726c8fd-f24c-4243-93da-b0de080dfe8b-kube-api-access-crfcg" pod "f726c8fd-f24c-4243-93da-b0de080dfe8b" (UID: "f726c8fd-f24c-4243-93da-b0de080dfe8b"). InnerVolumeSpecName "kube-api-access-crfcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:05:46.071603 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.071499    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/f726c8fd-f24c-4243-93da-b0de080dfe8b-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:46.071603 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.071584    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crfcg\" (UniqueName: \"kubernetes.io/projected/f726c8fd-f24c-4243-93da-b0de080dfe8b-kube-api-access-crfcg\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:46.071603 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.071605    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/f726c8fd-f24c-4243-93da-b0de080dfe8b-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:05:46.610397 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.610358    5937 generic.go:356] "Generic (PLEG): container finished" podID="f726c8fd-f24c-4243-93da-b0de080dfe8b" containerID="8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6" exitCode=0
Oct 30 21:05:46.610688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.610410    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"
Oct 30 21:05:46.610688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.610448    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd" event={"ID":"f726c8fd-f24c-4243-93da-b0de080dfe8b","Type":"ContainerDied","Data":"8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6"}
Oct 30 21:05:46.610688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.610496    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd" event={"ID":"f726c8fd-f24c-4243-93da-b0de080dfe8b","Type":"ContainerDied","Data":"093ffc1bd8624866465898598744b6ce375c1659dc5fe55ff093133c556ba143"}
Oct 30 21:05:46.610688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.610514    5937 scope.go:122] "RemoveContainer" containerID="8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6"
Oct 30 21:05:46.619174 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.619153    5937 scope.go:122] "RemoveContainer" containerID="8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6"
Oct 30 21:05:46.619436 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:05:46.619420    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6\": container with ID starting with 8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6 not found: ID does not exist" containerID="8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6"
Oct 30 21:05:46.619482 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.619443    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6"} err="failed to get container status \"8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6\": rpc error: code = NotFound desc = could not find container \"8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6\": container with ID starting with 8430b7b3465c4b00323d6561f9fca0ddfce030c646d963693f105d85e4ce08b6 not found: ID does not exist"
Oct 30 21:05:46.779565 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.778358    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"]
Oct 30 21:05:46.827237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:46.827206    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-86d45c7dff-bcfsd"]
Oct 30 21:05:47.161429 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:05:47.161398    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f726c8fd-f24c-4243-93da-b0de080dfe8b" path="/var/lib/kubelet/pods/f726c8fd-f24c-4243-93da-b0de080dfe8b/volumes"
Oct 30 21:06:15.671831 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:06:15.671794    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:06:45.670408 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:06:45.670371    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:07:15.672022 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:07:15.671941    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:07:43.681571 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.681518    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"]
Oct 30 21:07:43.682026 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.681913    5937 cpu_manager.go:414] "containerMap: removing container" podUID="f726c8fd-f24c-4243-93da-b0de080dfe8b" containerName="ta-container"
Oct 30 21:07:43.682026 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.681927    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f726c8fd-f24c-4243-93da-b0de080dfe8b" containerName="ta-container"
Oct 30 21:07:43.682026 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.681953    5937 cpu_manager.go:414] "containerMap: removing container" podUID="1b1bb2b8-89bd-49ee-8caf-686135eb164f" containerName="ta-container"
Oct 30 21:07:43.682026 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.681958    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1b1bb2b8-89bd-49ee-8caf-686135eb164f" containerName="ta-container"
Oct 30 21:07:43.682155 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.682029    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="1b1bb2b8-89bd-49ee-8caf-686135eb164f" containerName="ta-container"
Oct 30 21:07:43.682155 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.682043    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="f726c8fd-f24c-4243-93da-b0de080dfe8b" containerName="ta-container"
Oct 30 21:07:43.685410 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.685394    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.702881 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.702857    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr89z\" (UniqueName: \"kubernetes.io/projected/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-kube-api-access-xr89z\") pod \"data-science-collector-targetallocator-754cf6487d-78xnt\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.703019 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.702985    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-754cf6487d-78xnt\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.703084 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.703052    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-ta-internal\") pod \"data-science-collector-targetallocator-754cf6487d-78xnt\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.726053 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.726028    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"]
Oct 30 21:07:43.726227 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:07:43.726206    5937 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[data-science-collector-ta-server-cert kube-api-access-xr89z ta-internal], unattached volumes=[], failed to process volumes=[]: context canceled" pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt" podUID="d7e6ca99-0efb-40a5-a54a-bfab06e71aa3"
Oct 30 21:07:43.744916 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.744896    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"]
Oct 30 21:07:43.748091 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.748077    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:43.748307 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.748290    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:07:43.776128 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.776104    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:07:43.794072 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.794044    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-ltdzb\""
Oct 30 21:07:43.803623 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.803597    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8nxq\" (UniqueName: \"kubernetes.io/projected/0dfe0721-0a6f-4d1f-9590-4068b5a25111-kube-api-access-s8nxq\") pod \"data-science-collector-targetallocator-6bfbfc58fc-crnbz\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:43.803717 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.803632    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-754cf6487d-78xnt\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.803717 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.803654    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dfe0721-0a6f-4d1f-9590-4068b5a25111-ta-internal\") pod \"data-science-collector-targetallocator-6bfbfc58fc-crnbz\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:43.803828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.803733    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-ta-internal\") pod \"data-science-collector-targetallocator-754cf6487d-78xnt\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.803828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.803778    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr89z\" (UniqueName: \"kubernetes.io/projected/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-kube-api-access-xr89z\") pod \"data-science-collector-targetallocator-754cf6487d-78xnt\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.803928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.803833    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dfe0721-0a6f-4d1f-9590-4068b5a25111-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6bfbfc58fc-crnbz\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:43.804441 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.804422    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-ta-internal\") pod \"data-science-collector-targetallocator-754cf6487d-78xnt\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.806739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.806719    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-754cf6487d-78xnt\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.810684 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.810658    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"]
Oct 30 21:07:43.866222 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.866190    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr89z\" (UniqueName: \"kubernetes.io/projected/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-kube-api-access-xr89z\") pod \"data-science-collector-targetallocator-754cf6487d-78xnt\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:43.877013 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.876984    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"]
Oct 30 21:07:43.904819 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.904786    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dfe0721-0a6f-4d1f-9590-4068b5a25111-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6bfbfc58fc-crnbz\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:43.904983 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.904841    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8nxq\" (UniqueName: \"kubernetes.io/projected/0dfe0721-0a6f-4d1f-9590-4068b5a25111-kube-api-access-s8nxq\") pod \"data-science-collector-targetallocator-6bfbfc58fc-crnbz\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:43.904983 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.904866    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dfe0721-0a6f-4d1f-9590-4068b5a25111-ta-internal\") pod \"data-science-collector-targetallocator-6bfbfc58fc-crnbz\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:43.905616 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.905595    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dfe0721-0a6f-4d1f-9590-4068b5a25111-ta-internal\") pod \"data-science-collector-targetallocator-6bfbfc58fc-crnbz\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:43.907396 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.907372    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dfe0721-0a6f-4d1f-9590-4068b5a25111-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6bfbfc58fc-crnbz\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:43.967475 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:43.967448    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8nxq\" (UniqueName: \"kubernetes.io/projected/0dfe0721-0a6f-4d1f-9590-4068b5a25111-kube-api-access-s8nxq\") pod \"data-science-collector-targetallocator-6bfbfc58fc-crnbz\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:44.059551 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.059495    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:44.129124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.129093    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:44.136557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.136510    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:44.207919 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.207887    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-ta-internal\") pod \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") "
Oct 30 21:07:44.208088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.207926    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-data-science-collector-ta-server-cert\") pod \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") "
Oct 30 21:07:44.208088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.208014    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-kube-api-access-xr89z\" (UniqueName: \"kubernetes.io/projected/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-kube-api-access-xr89z\") pod \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\" (UID: \"d7e6ca99-0efb-40a5-a54a-bfab06e71aa3\") "
Oct 30 21:07:44.208240 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.208216    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-ta-internal" pod "d7e6ca99-0efb-40a5-a54a-bfab06e71aa3" (UID: "d7e6ca99-0efb-40a5-a54a-bfab06e71aa3"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:07:44.210187 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.210160    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-data-science-collector-ta-server-cert" pod "d7e6ca99-0efb-40a5-a54a-bfab06e71aa3" (UID: "d7e6ca99-0efb-40a5-a54a-bfab06e71aa3"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:07:44.210295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.210201    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-kube-api-access-xr89z" pod "d7e6ca99-0efb-40a5-a54a-bfab06e71aa3" (UID: "d7e6ca99-0efb-40a5-a54a-bfab06e71aa3"). InnerVolumeSpecName "kube-api-access-xr89z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:07:44.309185 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.309109    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr89z\" (UniqueName: \"kubernetes.io/projected/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-kube-api-access-xr89z\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:44.309185 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.309135    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:44.309185 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.309145    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:07:44.435139 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.435107    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"]
Oct 30 21:07:44.438765 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:07:44.438742    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dfe0721_0a6f_4d1f_9590_4068b5a25111.slice/crio-d43943564117c3d4ba262bbf0f5d0a157da09c2faa465793e7e30dd1b2a5f0de WatchSource:0}: Error finding container d43943564117c3d4ba262bbf0f5d0a157da09c2faa465793e7e30dd1b2a5f0de: Status 404 returned error can't find the container with id d43943564117c3d4ba262bbf0f5d0a157da09c2faa465793e7e30dd1b2a5f0de
Oct 30 21:07:44.440908 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.440877    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:07:44.440961 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:44.440935    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:07:45.134946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:45.134869    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"
Oct 30 21:07:45.134946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:45.134895    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz" event={"ID":"0dfe0721-0a6f-4d1f-9590-4068b5a25111","Type":"ContainerStarted","Data":"a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4"}
Oct 30 21:07:45.134946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:45.134932    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz" event={"ID":"0dfe0721-0a6f-4d1f-9590-4068b5a25111","Type":"ContainerStarted","Data":"d43943564117c3d4ba262bbf0f5d0a157da09c2faa465793e7e30dd1b2a5f0de"}
Oct 30 21:07:45.135423 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:45.135122    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:45.136460 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:45.136435    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz" podUID="0dfe0721-0a6f-4d1f-9590-4068b5a25111" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.60:8080/readyz\": dial tcp 10.134.0.60:8080: connect: connection refused"
Oct 30 21:07:45.310215 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:45.310147    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz" podStartSLOduration=2.310128993 podStartE2EDuration="2.310128993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:07:45.309369563 +0000 UTC m=+1840.265384342" watchObservedRunningTime="2026-10-30 21:07:45.310128993 +0000 UTC m=+1840.266143769"
Oct 30 21:07:45.485938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:45.485910    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"]
Oct 30 21:07:45.490449 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:45.490416    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-754cf6487d-78xnt"]
Oct 30 21:07:45.672398 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:07:45.672358    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:07:46.140401 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:46.140373    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:07:47.160603 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:07:47.160571    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7e6ca99-0efb-40a5-a54a-bfab06e71aa3" path="/var/lib/kubelet/pods/d7e6ca99-0efb-40a5-a54a-bfab06e71aa3/volumes"
Oct 30 21:08:15.671775 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:08:15.671741    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:08:29.613257 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.613213    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"]
Oct 30 21:08:29.616628 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.616609    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:29.674698 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.674673    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"]
Oct 30 21:08:29.797375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.797344    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a11cdf26-4663-43a4-985b-20c24f18eef5-ta-internal\") pod \"data-science-collector-targetallocator-6c6c7b9779-4dtkj\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:29.797586 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.797396    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a11cdf26-4663-43a4-985b-20c24f18eef5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c6c7b9779-4dtkj\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:29.797586 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.797520    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zm6f\" (UniqueName: \"kubernetes.io/projected/a11cdf26-4663-43a4-985b-20c24f18eef5-kube-api-access-8zm6f\") pod \"data-science-collector-targetallocator-6c6c7b9779-4dtkj\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:29.898888 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.898810    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a11cdf26-4663-43a4-985b-20c24f18eef5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c6c7b9779-4dtkj\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:29.898888 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.898860    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zm6f\" (UniqueName: \"kubernetes.io/projected/a11cdf26-4663-43a4-985b-20c24f18eef5-kube-api-access-8zm6f\") pod \"data-science-collector-targetallocator-6c6c7b9779-4dtkj\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:29.899092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.898941    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a11cdf26-4663-43a4-985b-20c24f18eef5-ta-internal\") pod \"data-science-collector-targetallocator-6c6c7b9779-4dtkj\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:29.899567 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.899514    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a11cdf26-4663-43a4-985b-20c24f18eef5-ta-internal\") pod \"data-science-collector-targetallocator-6c6c7b9779-4dtkj\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:29.901364 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.901337    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a11cdf26-4663-43a4-985b-20c24f18eef5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c6c7b9779-4dtkj\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:29.977644 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:29.977617    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zm6f\" (UniqueName: \"kubernetes.io/projected/a11cdf26-4663-43a4-985b-20c24f18eef5-kube-api-access-8zm6f\") pod \"data-science-collector-targetallocator-6c6c7b9779-4dtkj\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:30.227647 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:30.227617    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:30.599730 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:30.599653    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"]
Oct 30 21:08:30.602856 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:08:30.602826    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda11cdf26_4663_43a4_985b_20c24f18eef5.slice/crio-572fbd944fe972e6a3f073ae3d7a117f497086547c5278b1e727ce438c906192 WatchSource:0}: Error finding container 572fbd944fe972e6a3f073ae3d7a117f497086547c5278b1e727ce438c906192: Status 404 returned error can't find the container with id 572fbd944fe972e6a3f073ae3d7a117f497086547c5278b1e727ce438c906192
Oct 30 21:08:30.604928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:30.604897    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:08:30.605033 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:30.604966    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:08:31.335102 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:31.335064    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj" event={"ID":"a11cdf26-4663-43a4-985b-20c24f18eef5","Type":"ContainerStarted","Data":"5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46"}
Oct 30 21:08:31.335525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:31.335112    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj" event={"ID":"a11cdf26-4663-43a4-985b-20c24f18eef5","Type":"ContainerStarted","Data":"572fbd944fe972e6a3f073ae3d7a117f497086547c5278b1e727ce438c906192"}
Oct 30 21:08:31.335525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:31.335219    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:31.336252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:31.336229    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj" podUID="a11cdf26-4663-43a4-985b-20c24f18eef5" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.62:8080/readyz\": dial tcp 10.134.0.62:8080: connect: connection refused"
Oct 30 21:08:31.454609 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:31.454553    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj" podStartSLOduration=2.454521757 podStartE2EDuration="2.454521757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:08:31.453783847 +0000 UTC m=+1886.409798623" watchObservedRunningTime="2026-10-30 21:08:31.454521757 +0000 UTC m=+1886.410536530"
Oct 30 21:08:32.341211 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.341181    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:32.513769 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.513733    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"]
Oct 30 21:08:32.514017 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.513989    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz" podUID="0dfe0721-0a6f-4d1f-9590-4068b5a25111" containerName="ta-container" containerID="cri-o://a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4" gracePeriod=30
Oct 30 21:08:32.759560 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.759517    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:08:32.925078 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.924997    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0dfe0721-0a6f-4d1f-9590-4068b5a25111-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dfe0721-0a6f-4d1f-9590-4068b5a25111-data-science-collector-ta-server-cert\") pod \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") "
Oct 30 21:08:32.925245 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.925103    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0dfe0721-0a6f-4d1f-9590-4068b5a25111-kube-api-access-s8nxq\" (UniqueName: \"kubernetes.io/projected/0dfe0721-0a6f-4d1f-9590-4068b5a25111-kube-api-access-s8nxq\") pod \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") "
Oct 30 21:08:32.925245 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.925193    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0dfe0721-0a6f-4d1f-9590-4068b5a25111-ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dfe0721-0a6f-4d1f-9590-4068b5a25111-ta-internal\") pod \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\" (UID: \"0dfe0721-0a6f-4d1f-9590-4068b5a25111\") "
Oct 30 21:08:32.925636 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.925608    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dfe0721-0a6f-4d1f-9590-4068b5a25111-ta-internal" pod "0dfe0721-0a6f-4d1f-9590-4068b5a25111" (UID: "0dfe0721-0a6f-4d1f-9590-4068b5a25111"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:08:32.927418 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.927394    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dfe0721-0a6f-4d1f-9590-4068b5a25111-kube-api-access-s8nxq" pod "0dfe0721-0a6f-4d1f-9590-4068b5a25111" (UID: "0dfe0721-0a6f-4d1f-9590-4068b5a25111"). InnerVolumeSpecName "kube-api-access-s8nxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:08:32.927623 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:32.927491    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dfe0721-0a6f-4d1f-9590-4068b5a25111-data-science-collector-ta-server-cert" pod "0dfe0721-0a6f-4d1f-9590-4068b5a25111" (UID: "0dfe0721-0a6f-4d1f-9590-4068b5a25111"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:33.026470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.026446    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8nxq\" (UniqueName: \"kubernetes.io/projected/0dfe0721-0a6f-4d1f-9590-4068b5a25111-kube-api-access-s8nxq\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:33.026470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.026469    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0dfe0721-0a6f-4d1f-9590-4068b5a25111-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:33.026651 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.026480    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0dfe0721-0a6f-4d1f-9590-4068b5a25111-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:33.345479 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.345448    5937 generic.go:356] "Generic (PLEG): container finished" podID="0dfe0721-0a6f-4d1f-9590-4068b5a25111" containerID="a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4" exitCode=0
Oct 30 21:08:33.346012 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.345493    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"
Oct 30 21:08:33.346012 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.345565    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz" event={"ID":"0dfe0721-0a6f-4d1f-9590-4068b5a25111","Type":"ContainerDied","Data":"a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4"}
Oct 30 21:08:33.346012 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.345612    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz" event={"ID":"0dfe0721-0a6f-4d1f-9590-4068b5a25111","Type":"ContainerDied","Data":"d43943564117c3d4ba262bbf0f5d0a157da09c2faa465793e7e30dd1b2a5f0de"}
Oct 30 21:08:33.346012 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.345635    5937 scope.go:122] "RemoveContainer" containerID="a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4"
Oct 30 21:08:33.354195 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.354178    5937 scope.go:122] "RemoveContainer" containerID="a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4"
Oct 30 21:08:33.354454 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:08:33.354434    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4\": container with ID starting with a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4 not found: ID does not exist" containerID="a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4"
Oct 30 21:08:33.354504 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.354463    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4"} err="failed to get container status \"a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4\": rpc error: code = NotFound desc = could not find container \"a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4\": container with ID starting with a43f23c35e689921942f3893aaa5c8a5c354ab6f73102da48daecae341fde9c4 not found: ID does not exist"
Oct 30 21:08:33.517210 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.517183    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"]
Oct 30 21:08:33.521568 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:33.521528    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6bfbfc58fc-crnbz"]
Oct 30 21:08:35.161078 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:35.161047    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0dfe0721-0a6f-4d1f-9590-4068b5a25111" path="/var/lib/kubelet/pods/0dfe0721-0a6f-4d1f-9590-4068b5a25111/volumes"
Oct 30 21:08:43.870010 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:43.869976    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"]
Oct 30 21:08:43.870522 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:43.870502    5937 cpu_manager.go:414] "containerMap: removing container" podUID="0dfe0721-0a6f-4d1f-9590-4068b5a25111" containerName="ta-container"
Oct 30 21:08:43.870632 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:43.870525    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0dfe0721-0a6f-4d1f-9590-4068b5a25111" containerName="ta-container"
Oct 30 21:08:43.870689 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:43.870653    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="0dfe0721-0a6f-4d1f-9590-4068b5a25111" containerName="ta-container"
Oct 30 21:08:43.875016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:43.874996    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:43.925374 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:43.925352    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4a72ba86-75a6-45ef-bd7a-afa1511fb959-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d66974cd4-sb5mj\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:43.925493 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:43.925413    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4a72ba86-75a6-45ef-bd7a-afa1511fb959-ta-internal\") pod \"data-science-collector-targetallocator-d66974cd4-sb5mj\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:43.925581 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:43.925557    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccv4s\" (UniqueName: \"kubernetes.io/projected/4a72ba86-75a6-45ef-bd7a-afa1511fb959-kube-api-access-ccv4s\") pod \"data-science-collector-targetallocator-d66974cd4-sb5mj\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:43.932868 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:43.932847    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"]
Oct 30 21:08:44.026225 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.026192    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4a72ba86-75a6-45ef-bd7a-afa1511fb959-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d66974cd4-sb5mj\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:44.026358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.026264    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4a72ba86-75a6-45ef-bd7a-afa1511fb959-ta-internal\") pod \"data-science-collector-targetallocator-d66974cd4-sb5mj\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:44.026358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.026287    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccv4s\" (UniqueName: \"kubernetes.io/projected/4a72ba86-75a6-45ef-bd7a-afa1511fb959-kube-api-access-ccv4s\") pod \"data-science-collector-targetallocator-d66974cd4-sb5mj\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:44.026953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.026928    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4a72ba86-75a6-45ef-bd7a-afa1511fb959-ta-internal\") pod \"data-science-collector-targetallocator-d66974cd4-sb5mj\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:44.028776 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.028758    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4a72ba86-75a6-45ef-bd7a-afa1511fb959-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d66974cd4-sb5mj\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:44.089468 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.089444    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccv4s\" (UniqueName: \"kubernetes.io/projected/4a72ba86-75a6-45ef-bd7a-afa1511fb959-kube-api-access-ccv4s\") pod \"data-science-collector-targetallocator-d66974cd4-sb5mj\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:44.186466 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.186399    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:44.555831 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.555696    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"]
Oct 30 21:08:44.558348 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:08:44.558320    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a72ba86_75a6_45ef_bd7a_afa1511fb959.slice/crio-13a5d4741f2fc50b93e91734cddf677066afff92c5fc915c262c27680ad29aaf WatchSource:0}: Error finding container 13a5d4741f2fc50b93e91734cddf677066afff92c5fc915c262c27680ad29aaf: Status 404 returned error can't find the container with id 13a5d4741f2fc50b93e91734cddf677066afff92c5fc915c262c27680ad29aaf
Oct 30 21:08:44.560680 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.560643    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:08:44.560768 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:44.560714    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:08:45.405235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:45.405199    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj" event={"ID":"4a72ba86-75a6-45ef-bd7a-afa1511fb959","Type":"ContainerStarted","Data":"5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7"}
Oct 30 21:08:45.405235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:45.405239    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj" event={"ID":"4a72ba86-75a6-45ef-bd7a-afa1511fb959","Type":"ContainerStarted","Data":"13a5d4741f2fc50b93e91734cddf677066afff92c5fc915c262c27680ad29aaf"}
Oct 30 21:08:45.405787 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:45.405377    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:45.406517 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:45.406492    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj" podUID="4a72ba86-75a6-45ef-bd7a-afa1511fb959" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.63:8080/readyz\": dial tcp 10.134.0.63:8080: connect: connection refused"
Oct 30 21:08:45.524510 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:45.524462    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj" podStartSLOduration=2.524447416 podStartE2EDuration="2.524447416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:08:45.523659136 +0000 UTC m=+1900.479673913" watchObservedRunningTime="2026-10-30 21:08:45.524447416 +0000 UTC m=+1900.480462191"
Oct 30 21:08:45.670988 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:08:45.670912    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:08:46.409896 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.409870    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:08:46.580597 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.580568    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"]
Oct 30 21:08:46.580802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.580779    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj" podUID="a11cdf26-4663-43a4-985b-20c24f18eef5" containerName="ta-container" containerID="cri-o://5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46" gracePeriod=30
Oct 30 21:08:46.821284 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.821262    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:46.851704 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.851679    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a11cdf26-4663-43a4-985b-20c24f18eef5-ta-internal\" (UniqueName: \"kubernetes.io/configmap/a11cdf26-4663-43a4-985b-20c24f18eef5-ta-internal\") pod \"a11cdf26-4663-43a4-985b-20c24f18eef5\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") "
Oct 30 21:08:46.851820 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.851762    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a11cdf26-4663-43a4-985b-20c24f18eef5-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a11cdf26-4663-43a4-985b-20c24f18eef5-data-science-collector-ta-server-cert\") pod \"a11cdf26-4663-43a4-985b-20c24f18eef5\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") "
Oct 30 21:08:46.851870 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.851817    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a11cdf26-4663-43a4-985b-20c24f18eef5-kube-api-access-8zm6f\" (UniqueName: \"kubernetes.io/projected/a11cdf26-4663-43a4-985b-20c24f18eef5-kube-api-access-8zm6f\") pod \"a11cdf26-4663-43a4-985b-20c24f18eef5\" (UID: \"a11cdf26-4663-43a4-985b-20c24f18eef5\") "
Oct 30 21:08:46.852062 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.852039    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a11cdf26-4663-43a4-985b-20c24f18eef5-ta-internal" pod "a11cdf26-4663-43a4-985b-20c24f18eef5" (UID: "a11cdf26-4663-43a4-985b-20c24f18eef5"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:08:46.853863 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.853841    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a11cdf26-4663-43a4-985b-20c24f18eef5-data-science-collector-ta-server-cert" pod "a11cdf26-4663-43a4-985b-20c24f18eef5" (UID: "a11cdf26-4663-43a4-985b-20c24f18eef5"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:08:46.853961 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.853942    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a11cdf26-4663-43a4-985b-20c24f18eef5-kube-api-access-8zm6f" pod "a11cdf26-4663-43a4-985b-20c24f18eef5" (UID: "a11cdf26-4663-43a4-985b-20c24f18eef5"). InnerVolumeSpecName "kube-api-access-8zm6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:08:46.953259 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.953237    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a11cdf26-4663-43a4-985b-20c24f18eef5-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:46.953382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.953262    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a11cdf26-4663-43a4-985b-20c24f18eef5-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:46.953382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:46.953274    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zm6f\" (UniqueName: \"kubernetes.io/projected/a11cdf26-4663-43a4-985b-20c24f18eef5-kube-api-access-8zm6f\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:08:47.420393 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:47.420300    5937 generic.go:356] "Generic (PLEG): container finished" podID="a11cdf26-4663-43a4-985b-20c24f18eef5" containerID="5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46" exitCode=0
Oct 30 21:08:47.420393 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:47.420371    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj" event={"ID":"a11cdf26-4663-43a4-985b-20c24f18eef5","Type":"ContainerDied","Data":"5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46"}
Oct 30 21:08:47.421029 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:47.420396    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"
Oct 30 21:08:47.421029 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:47.420420    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj" event={"ID":"a11cdf26-4663-43a4-985b-20c24f18eef5","Type":"ContainerDied","Data":"572fbd944fe972e6a3f073ae3d7a117f497086547c5278b1e727ce438c906192"}
Oct 30 21:08:47.421029 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:47.420441    5937 scope.go:122] "RemoveContainer" containerID="5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46"
Oct 30 21:08:47.429134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:47.429115    5937 scope.go:122] "RemoveContainer" containerID="5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46"
Oct 30 21:08:47.429392 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:08:47.429374    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46\": container with ID starting with 5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46 not found: ID does not exist" containerID="5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46"
Oct 30 21:08:47.429441 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:47.429399    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46"} err="failed to get container status \"5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46\": rpc error: code = NotFound desc = could not find container \"5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46\": container with ID starting with 5cd795427e517e16ebb2176bf535752ab3970f9f7d5d5e953eaadbed62651b46 not found: ID does not exist"
Oct 30 21:08:47.586828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:47.586799    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"]
Oct 30 21:08:47.637558 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:47.637503    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c6c7b9779-4dtkj"]
Oct 30 21:08:49.160987 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:08:49.160955    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a11cdf26-4663-43a4-985b-20c24f18eef5" path="/var/lib/kubelet/pods/a11cdf26-4663-43a4-985b-20c24f18eef5/volumes"
Oct 30 21:09:15.671402 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:09:15.671365    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:09:20.225888 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.225855    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 21:09:20.226349 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.226212    5937 cpu_manager.go:414] "containerMap: removing container" podUID="a11cdf26-4663-43a4-985b-20c24f18eef5" containerName="ta-container"
Oct 30 21:09:20.226349 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.226222    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a11cdf26-4663-43a4-985b-20c24f18eef5" containerName="ta-container"
Oct 30 21:09:20.226349 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.226288    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="a11cdf26-4663-43a4-985b-20c24f18eef5" containerName="ta-container"
Oct 30 21:09:20.230331 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.230315    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 21:09:20.283626 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.283604    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 21:09:20.283755 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.283703    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"tests-monitoring-otlp-identity\"/\"openshift-service-ca.crt\""
Oct 30 21:09:20.336649 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.336621    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"tests-monitoring-otlp-identity\"/\"default-dockercfg-s7hnh\""
Oct 30 21:09:20.340508 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.340486    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/450a4ff3-302a-4417-ba24-e5ac976070f6-service-ca\") pod \"otlp-identity-spoof-probe\" (UID: \"450a4ff3-302a-4417-ba24-e5ac976070f6\") " pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 21:09:20.441303 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.441273    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/450a4ff3-302a-4417-ba24-e5ac976070f6-service-ca\") pod \"otlp-identity-spoof-probe\" (UID: \"450a4ff3-302a-4417-ba24-e5ac976070f6\") " pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 21:09:20.441857 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.441836    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/450a4ff3-302a-4417-ba24-e5ac976070f6-service-ca\") pod \"otlp-identity-spoof-probe\" (UID: \"450a4ff3-302a-4417-ba24-e5ac976070f6\") " pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 21:09:20.541984 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.541920    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 21:09:20.922829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:20.922749    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 21:09:20.926832 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:09:20.926803    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod450a4ff3_302a_4417_ba24_e5ac976070f6.slice/crio-a00615c1d367528ba2f83baddd077b5b7dd5eb199d0c5b76a6f8423c458d39a0 WatchSource:0}: Error finding container a00615c1d367528ba2f83baddd077b5b7dd5eb199d0c5b76a6f8423c458d39a0: Status 404 returned error can't find the container with id a00615c1d367528ba2f83baddd077b5b7dd5eb199d0c5b76a6f8423c458d39a0
Oct 30 21:09:21.575293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:21.575260    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"450a4ff3-302a-4417-ba24-e5ac976070f6","Type":"ContainerStarted","Data":"67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837"}
Oct 30 21:09:21.575697 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:21.575302    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"450a4ff3-302a-4417-ba24-e5ac976070f6","Type":"ContainerStarted","Data":"a00615c1d367528ba2f83baddd077b5b7dd5eb199d0c5b76a6f8423c458d39a0"}
Oct 30 21:09:21.691482 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:09:21.691434    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" podStartSLOduration=1.691418676 podStartE2EDuration="1.691418676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:09:21.690807975 +0000 UTC m=+1936.646822753" watchObservedRunningTime="2026-10-30 21:09:21.691418676 +0000 UTC m=+1936.647433446"
Oct 30 21:09:45.671622 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:09:45.671587    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:10:15.670456 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:10:15.670375    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:10:45.672381 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:10:45.672340    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:11:15.671002 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:11:15.670965    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:11:35.673839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:11:35.673803    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 21:11:35.674431 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:11:35.674010    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" podUID="450a4ff3-302a-4417-ba24-e5ac976070f6" containerName="otlp-spoof-probe" containerID="cri-o://67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837" gracePeriod=30
Oct 30 21:11:45.671252 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:11:45.671169    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:12:05.830915 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:05.830886    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 21:12:05.972752 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:05.972724    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/450a4ff3-302a-4417-ba24-e5ac976070f6-service-ca\" (UniqueName: \"kubernetes.io/configmap/450a4ff3-302a-4417-ba24-e5ac976070f6-service-ca\") pod \"450a4ff3-302a-4417-ba24-e5ac976070f6\" (UID: \"450a4ff3-302a-4417-ba24-e5ac976070f6\") "
Oct 30 21:12:05.973055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:05.973027    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/450a4ff3-302a-4417-ba24-e5ac976070f6-service-ca" pod "450a4ff3-302a-4417-ba24-e5ac976070f6" (UID: "450a4ff3-302a-4417-ba24-e5ac976070f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:06.073377 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.073346    5937 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/450a4ff3-302a-4417-ba24-e5ac976070f6-service-ca\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:06.313237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.313162    5937 generic.go:356] "Generic (PLEG): container finished" podID="450a4ff3-302a-4417-ba24-e5ac976070f6" containerID="67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837" exitCode=137
Oct 30 21:12:06.313237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.313200    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"450a4ff3-302a-4417-ba24-e5ac976070f6","Type":"ContainerDied","Data":"67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837"}
Oct 30 21:12:06.313237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.313207    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe"
Oct 30 21:12:06.313237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.313226    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="tests-monitoring-otlp-identity/otlp-identity-spoof-probe" event={"ID":"450a4ff3-302a-4417-ba24-e5ac976070f6","Type":"ContainerDied","Data":"a00615c1d367528ba2f83baddd077b5b7dd5eb199d0c5b76a6f8423c458d39a0"}
Oct 30 21:12:06.313237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.313242    5937 scope.go:122] "RemoveContainer" containerID="67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837"
Oct 30 21:12:06.322175 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.322157    5937 scope.go:122] "RemoveContainer" containerID="67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837"
Oct 30 21:12:06.322456 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:12:06.322436    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837\": container with ID starting with 67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837 not found: ID does not exist" containerID="67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837"
Oct 30 21:12:06.322503 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.322464    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837"} err="failed to get container status \"67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837\": rpc error: code = NotFound desc = could not find container \"67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837\": container with ID starting with 67439ebaeb8376c48245bfa0acc08b34dc956feb114996bfa3e279ea752c4837 not found: ID does not exist"
Oct 30 21:12:06.479110 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.479073    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 21:12:06.482928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:06.482906    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["tests-monitoring-otlp-identity/otlp-identity-spoof-probe"]
Oct 30 21:12:07.161344 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:07.161313    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="450a4ff3-302a-4417-ba24-e5ac976070f6" path="/var/lib/kubelet/pods/450a4ff3-302a-4417-ba24-e5ac976070f6/volumes"
Oct 30 21:12:15.671942 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:12:15.671907    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:12:20.208053 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.208018    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"]
Oct 30 21:12:20.208444 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.208410    5937 cpu_manager.go:414] "containerMap: removing container" podUID="450a4ff3-302a-4417-ba24-e5ac976070f6" containerName="otlp-spoof-probe"
Oct 30 21:12:20.208444 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.208421    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="450a4ff3-302a-4417-ba24-e5ac976070f6" containerName="otlp-spoof-probe"
Oct 30 21:12:20.208517 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.208482    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="450a4ff3-302a-4417-ba24-e5ac976070f6" containerName="otlp-spoof-probe"
Oct 30 21:12:20.213036 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.213013    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.270597 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.270564    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"]
Oct 30 21:12:20.294121 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.294076    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/62e0a841-4117-400c-8255-e83378134a58-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66886b8f77-6qkwt\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.294318 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.294191    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7q9f\" (UniqueName: \"kubernetes.io/projected/62e0a841-4117-400c-8255-e83378134a58-kube-api-access-l7q9f\") pod \"data-science-collector-targetallocator-66886b8f77-6qkwt\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.294318 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.294272    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/62e0a841-4117-400c-8255-e83378134a58-ta-internal\") pod \"data-science-collector-targetallocator-66886b8f77-6qkwt\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.395134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.395095    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/62e0a841-4117-400c-8255-e83378134a58-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66886b8f77-6qkwt\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.395309 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.395161    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7q9f\" (UniqueName: \"kubernetes.io/projected/62e0a841-4117-400c-8255-e83378134a58-kube-api-access-l7q9f\") pod \"data-science-collector-targetallocator-66886b8f77-6qkwt\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.395309 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.395197    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/62e0a841-4117-400c-8255-e83378134a58-ta-internal\") pod \"data-science-collector-targetallocator-66886b8f77-6qkwt\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.395919 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.395894    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/62e0a841-4117-400c-8255-e83378134a58-ta-internal\") pod \"data-science-collector-targetallocator-66886b8f77-6qkwt\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.397806 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.397778    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/62e0a841-4117-400c-8255-e83378134a58-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66886b8f77-6qkwt\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.457426 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.457391    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7q9f\" (UniqueName: \"kubernetes.io/projected/62e0a841-4117-400c-8255-e83378134a58-kube-api-access-l7q9f\") pod \"data-science-collector-targetallocator-66886b8f77-6qkwt\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.525170 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.525075    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:20.899488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.899421    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"]
Oct 30 21:12:20.902320 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:12:20.902288    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62e0a841_4117_400c_8255_e83378134a58.slice/crio-fae388a2e711606f503db721c6280e2bf58a2990e6df1832bf6719a75d876a51 WatchSource:0}: Error finding container fae388a2e711606f503db721c6280e2bf58a2990e6df1832bf6719a75d876a51: Status 404 returned error can't find the container with id fae388a2e711606f503db721c6280e2bf58a2990e6df1832bf6719a75d876a51
Oct 30 21:12:20.904570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.904520    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:12:20.904664 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:20.904608    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:12:21.381175 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:21.381140    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt" event={"ID":"62e0a841-4117-400c-8255-e83378134a58","Type":"ContainerStarted","Data":"98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691"}
Oct 30 21:12:21.381648 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:21.381193    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt" event={"ID":"62e0a841-4117-400c-8255-e83378134a58","Type":"ContainerStarted","Data":"fae388a2e711606f503db721c6280e2bf58a2990e6df1832bf6719a75d876a51"}
Oct 30 21:12:21.381648 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:21.381217    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:21.382496 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:21.382471    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt" podUID="62e0a841-4117-400c-8255-e83378134a58" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.65:8080/readyz\": dial tcp 10.134.0.65:8080: connect: connection refused"
Oct 30 21:12:21.500190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:21.500124    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt" podStartSLOduration=1.500104113 podStartE2EDuration="1.500104113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:12:21.500012951 +0000 UTC m=+2116.456027730" watchObservedRunningTime="2026-10-30 21:12:21.500104113 +0000 UTC m=+2116.456118890"
Oct 30 21:12:22.386809 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.386784    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:22.557220 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.557189    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"]
Oct 30 21:12:22.557440 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.557413    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj" podUID="4a72ba86-75a6-45ef-bd7a-afa1511fb959" containerName="ta-container" containerID="cri-o://5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7" gracePeriod=30
Oct 30 21:12:22.817613 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.817588    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:12:22.915616 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.915575    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a72ba86-75a6-45ef-bd7a-afa1511fb959-kube-api-access-ccv4s\" (UniqueName: \"kubernetes.io/projected/4a72ba86-75a6-45ef-bd7a-afa1511fb959-kube-api-access-ccv4s\") pod \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") "
Oct 30 21:12:22.915616 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.915618    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4a72ba86-75a6-45ef-bd7a-afa1511fb959-ta-internal\" (UniqueName: \"kubernetes.io/configmap/4a72ba86-75a6-45ef-bd7a-afa1511fb959-ta-internal\") pod \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") "
Oct 30 21:12:22.915873 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.915678    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a72ba86-75a6-45ef-bd7a-afa1511fb959-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4a72ba86-75a6-45ef-bd7a-afa1511fb959-data-science-collector-ta-server-cert\") pod \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\" (UID: \"4a72ba86-75a6-45ef-bd7a-afa1511fb959\") "
Oct 30 21:12:22.916005 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.915980    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a72ba86-75a6-45ef-bd7a-afa1511fb959-ta-internal" pod "4a72ba86-75a6-45ef-bd7a-afa1511fb959" (UID: "4a72ba86-75a6-45ef-bd7a-afa1511fb959"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:22.917890 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.917859    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a72ba86-75a6-45ef-bd7a-afa1511fb959-data-science-collector-ta-server-cert" pod "4a72ba86-75a6-45ef-bd7a-afa1511fb959" (UID: "4a72ba86-75a6-45ef-bd7a-afa1511fb959"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:22.918011 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:22.917963    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a72ba86-75a6-45ef-bd7a-afa1511fb959-kube-api-access-ccv4s" pod "4a72ba86-75a6-45ef-bd7a-afa1511fb959" (UID: "4a72ba86-75a6-45ef-bd7a-afa1511fb959"). InnerVolumeSpecName "kube-api-access-ccv4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:23.016974 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.016933    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccv4s\" (UniqueName: \"kubernetes.io/projected/4a72ba86-75a6-45ef-bd7a-afa1511fb959-kube-api-access-ccv4s\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:23.016974 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.016966    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/4a72ba86-75a6-45ef-bd7a-afa1511fb959-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:23.016974 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.016981    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/4a72ba86-75a6-45ef-bd7a-afa1511fb959-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:23.391690 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.391598    5937 generic.go:356] "Generic (PLEG): container finished" podID="4a72ba86-75a6-45ef-bd7a-afa1511fb959" containerID="5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7" exitCode=0
Oct 30 21:12:23.391690 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.391644    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"
Oct 30 21:12:23.392173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.391683    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj" event={"ID":"4a72ba86-75a6-45ef-bd7a-afa1511fb959","Type":"ContainerDied","Data":"5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7"}
Oct 30 21:12:23.392173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.391730    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj" event={"ID":"4a72ba86-75a6-45ef-bd7a-afa1511fb959","Type":"ContainerDied","Data":"13a5d4741f2fc50b93e91734cddf677066afff92c5fc915c262c27680ad29aaf"}
Oct 30 21:12:23.392173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.391746    5937 scope.go:122] "RemoveContainer" containerID="5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7"
Oct 30 21:12:23.400186 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.400172    5937 scope.go:122] "RemoveContainer" containerID="5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7"
Oct 30 21:12:23.400439 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:12:23.400417    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7\": container with ID starting with 5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7 not found: ID does not exist" containerID="5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7"
Oct 30 21:12:23.400504 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.400451    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7"} err="failed to get container status \"5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7\": rpc error: code = NotFound desc = could not find container \"5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7\": container with ID starting with 5f3a65c468d44eb7d98368e158623bb4dea16d0598976c750b441c8ed89f4be7 not found: ID does not exist"
Oct 30 21:12:23.558316 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.558285    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"]
Oct 30 21:12:23.609045 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:23.609012    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d66974cd4-sb5mj"]
Oct 30 21:12:25.160738 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:25.160695    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a72ba86-75a6-45ef-bd7a-afa1511fb959" path="/var/lib/kubelet/pods/4a72ba86-75a6-45ef-bd7a-afa1511fb959/volumes"
Oct 30 21:12:45.425464 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.425429    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"]
Oct 30 21:12:45.426055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.425627    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt" podUID="62e0a841-4117-400c-8255-e83378134a58" containerName="ta-container" containerID="cri-o://98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691" gracePeriod=30
Oct 30 21:12:45.672594 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:12:45.672529    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:12:45.676248 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.676194    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:45.829843 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.829805    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/62e0a841-4117-400c-8255-e83378134a58-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/62e0a841-4117-400c-8255-e83378134a58-data-science-collector-ta-server-cert\") pod \"62e0a841-4117-400c-8255-e83378134a58\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") "
Oct 30 21:12:45.830028 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.829851    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62e0a841-4117-400c-8255-e83378134a58-kube-api-access-l7q9f\" (UniqueName: \"kubernetes.io/projected/62e0a841-4117-400c-8255-e83378134a58-kube-api-access-l7q9f\") pod \"62e0a841-4117-400c-8255-e83378134a58\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") "
Oct 30 21:12:45.830028 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.829877    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62e0a841-4117-400c-8255-e83378134a58-ta-internal\" (UniqueName: \"kubernetes.io/configmap/62e0a841-4117-400c-8255-e83378134a58-ta-internal\") pod \"62e0a841-4117-400c-8255-e83378134a58\" (UID: \"62e0a841-4117-400c-8255-e83378134a58\") "
Oct 30 21:12:45.830312 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.830283    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62e0a841-4117-400c-8255-e83378134a58-ta-internal" pod "62e0a841-4117-400c-8255-e83378134a58" (UID: "62e0a841-4117-400c-8255-e83378134a58"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:12:45.832311 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.832285    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62e0a841-4117-400c-8255-e83378134a58-data-science-collector-ta-server-cert" pod "62e0a841-4117-400c-8255-e83378134a58" (UID: "62e0a841-4117-400c-8255-e83378134a58"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:12:45.832434 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.832365    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62e0a841-4117-400c-8255-e83378134a58-kube-api-access-l7q9f" pod "62e0a841-4117-400c-8255-e83378134a58" (UID: "62e0a841-4117-400c-8255-e83378134a58"). InnerVolumeSpecName "kube-api-access-l7q9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:12:45.930527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.930466    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/62e0a841-4117-400c-8255-e83378134a58-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:45.930527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.930490    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7q9f\" (UniqueName: \"kubernetes.io/projected/62e0a841-4117-400c-8255-e83378134a58-kube-api-access-l7q9f\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:45.930527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:45.930501    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/62e0a841-4117-400c-8255-e83378134a58-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:12:46.494319 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:46.494289    5937 generic.go:356] "Generic (PLEG): container finished" podID="62e0a841-4117-400c-8255-e83378134a58" containerID="98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691" exitCode=0
Oct 30 21:12:46.494894 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:46.494331    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"
Oct 30 21:12:46.494894 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:46.494417    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt" event={"ID":"62e0a841-4117-400c-8255-e83378134a58","Type":"ContainerDied","Data":"98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691"}
Oct 30 21:12:46.494894 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:46.494464    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt" event={"ID":"62e0a841-4117-400c-8255-e83378134a58","Type":"ContainerDied","Data":"fae388a2e711606f503db721c6280e2bf58a2990e6df1832bf6719a75d876a51"}
Oct 30 21:12:46.494894 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:46.494490    5937 scope.go:122] "RemoveContainer" containerID="98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691"
Oct 30 21:12:46.504105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:46.504085    5937 scope.go:122] "RemoveContainer" containerID="98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691"
Oct 30 21:12:46.504368 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:12:46.504346    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691\": container with ID starting with 98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691 not found: ID does not exist" containerID="98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691"
Oct 30 21:12:46.504434 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:46.504382    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691"} err="failed to get container status \"98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691\": rpc error: code = NotFound desc = could not find container \"98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691\": container with ID starting with 98ec401a2d22a836f850124846094dc77a18a9bf71407b906bdb0b3c7e449691 not found: ID does not exist"
Oct 30 21:12:46.663087 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:46.663056    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"]
Oct 30 21:12:46.666417 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:46.666390    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66886b8f77-6qkwt"]
Oct 30 21:12:47.161489 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:47.161458    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62e0a841-4117-400c-8255-e83378134a58" path="/var/lib/kubelet/pods/62e0a841-4117-400c-8255-e83378134a58/volumes"
Oct 30 21:12:51.169772 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.169738    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"]
Oct 30 21:12:51.170262 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.170244    5937 cpu_manager.go:414] "containerMap: removing container" podUID="62e0a841-4117-400c-8255-e83378134a58" containerName="ta-container"
Oct 30 21:12:51.170334 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.170263    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62e0a841-4117-400c-8255-e83378134a58" containerName="ta-container"
Oct 30 21:12:51.170334 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.170292    5937 cpu_manager.go:414] "containerMap: removing container" podUID="4a72ba86-75a6-45ef-bd7a-afa1511fb959" containerName="ta-container"
Oct 30 21:12:51.170334 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.170301    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a72ba86-75a6-45ef-bd7a-afa1511fb959" containerName="ta-container"
Oct 30 21:12:51.170569 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.170417    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="62e0a841-4117-400c-8255-e83378134a58" containerName="ta-container"
Oct 30 21:12:51.170569 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.170432    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a72ba86-75a6-45ef-bd7a-afa1511fb959" containerName="ta-container"
Oct 30 21:12:51.174826 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.174807    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.230874 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.230846    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:12:51.231681 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.231658    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"]
Oct 30 21:12:51.276163 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.276128    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/11128895-840e-40f4-acdd-9dd7fbf90684-ta-internal\") pod \"data-science-collector-targetallocator-9fd97858d-sqvgf\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.276294 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.276266    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/11128895-840e-40f4-acdd-9dd7fbf90684-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-9fd97858d-sqvgf\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.276365 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.276319    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k466l\" (UniqueName: \"kubernetes.io/projected/11128895-840e-40f4-acdd-9dd7fbf90684-kube-api-access-k466l\") pod \"data-science-collector-targetallocator-9fd97858d-sqvgf\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.281113 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.281095    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:12:51.330514 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.330490    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-ltdzb\""
Oct 30 21:12:51.377399 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.377369    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/11128895-840e-40f4-acdd-9dd7fbf90684-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-9fd97858d-sqvgf\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.377523 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.377408    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k466l\" (UniqueName: \"kubernetes.io/projected/11128895-840e-40f4-acdd-9dd7fbf90684-kube-api-access-k466l\") pod \"data-science-collector-targetallocator-9fd97858d-sqvgf\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.377523 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.377447    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/11128895-840e-40f4-acdd-9dd7fbf90684-ta-internal\") pod \"data-science-collector-targetallocator-9fd97858d-sqvgf\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.378056 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.378039    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/11128895-840e-40f4-acdd-9dd7fbf90684-ta-internal\") pod \"data-science-collector-targetallocator-9fd97858d-sqvgf\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.379983 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.379967    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/11128895-840e-40f4-acdd-9dd7fbf90684-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-9fd97858d-sqvgf\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.440044 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.439972    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k466l\" (UniqueName: \"kubernetes.io/projected/11128895-840e-40f4-acdd-9dd7fbf90684-kube-api-access-k466l\") pod \"data-science-collector-targetallocator-9fd97858d-sqvgf\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.486311 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.486273    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:51.857147 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.857121    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"]
Oct 30 21:12:51.859945 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:12:51.859918    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11128895_840e_40f4_acdd_9dd7fbf90684.slice/crio-2bd6949e751307d62954ef0d274931d682735a9da9ee84b75d12711edc4de213 WatchSource:0}: Error finding container 2bd6949e751307d62954ef0d274931d682735a9da9ee84b75d12711edc4de213: Status 404 returned error can't find the container with id 2bd6949e751307d62954ef0d274931d682735a9da9ee84b75d12711edc4de213
Oct 30 21:12:51.862489 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.862458    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:12:51.862572 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:51.862514    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:12:52.522387 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:52.522350    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf" event={"ID":"11128895-840e-40f4-acdd-9dd7fbf90684","Type":"ContainerStarted","Data":"607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2"}
Oct 30 21:12:52.522812 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:52.522489    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:12:52.522812 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:52.522523    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf" event={"ID":"11128895-840e-40f4-acdd-9dd7fbf90684","Type":"ContainerStarted","Data":"2bd6949e751307d62954ef0d274931d682735a9da9ee84b75d12711edc4de213"}
Oct 30 21:12:52.523754 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:52.523732    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf" podUID="11128895-840e-40f4-acdd-9dd7fbf90684" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.66:8080/readyz\": dial tcp 10.134.0.66:8080: connect: connection refused"
Oct 30 21:12:52.641568 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:52.641475    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf" podStartSLOduration=1.64145583 podStartE2EDuration="1.64145583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:12:52.640327447 +0000 UTC m=+2147.596342223" watchObservedRunningTime="2026-10-30 21:12:52.64145583 +0000 UTC m=+2147.597470617"
Oct 30 21:12:53.528299 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:12:53.528272    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:13:15.671226 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:13:15.671135    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:13:45.672000 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:13:45.671960    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:13:48.261678 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:48.261645    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86"]
Oct 30 21:13:48.265050 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:48.265032    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86"
Oct 30 21:13:48.275939 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:48.275916    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86"
Oct 30 21:13:48.322839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:48.322805    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86"]
Oct 30 21:13:48.649626 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:48.649400    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86"]
Oct 30 21:13:48.652345 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:13:48.652318    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7915b1e_faa2_494e_9d9b_82c497514b4b.slice/crio-9d18c7c5bf105920c667716f8f930fcd48634f0d5fae57fce898a7140bb321d6 WatchSource:0}: Error finding container 9d18c7c5bf105920c667716f8f930fcd48634f0d5fae57fce898a7140bb321d6: Status 404 returned error can't find the container with id 9d18c7c5bf105920c667716f8f930fcd48634f0d5fae57fce898a7140bb321d6
Oct 30 21:13:48.766325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:48.766286    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86" event={"ID":"b7915b1e-faa2-494e-9d9b-82c497514b4b","Type":"ContainerStarted","Data":"4f67ba1e360ac63af5b54ff07108c3170ab9fc0fc2037cce8d1675aa3c7beb39"}
Oct 30 21:13:48.766487 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:48.766332    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86" event={"ID":"b7915b1e-faa2-494e-9d9b-82c497514b4b","Type":"ContainerStarted","Data":"9d18c7c5bf105920c667716f8f930fcd48634f0d5fae57fce898a7140bb321d6"}
Oct 30 21:13:58.811781 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:58.811747    5937 generic.go:356] "Generic (PLEG): container finished" podID="b7915b1e-faa2-494e-9d9b-82c497514b4b" containerID="4f67ba1e360ac63af5b54ff07108c3170ab9fc0fc2037cce8d1675aa3c7beb39" exitCode=0
Oct 30 21:13:58.812190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:58.811820    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86" event={"ID":"b7915b1e-faa2-494e-9d9b-82c497514b4b","Type":"ContainerDied","Data":"4f67ba1e360ac63af5b54ff07108c3170ab9fc0fc2037cce8d1675aa3c7beb39"}
Oct 30 21:13:59.948701 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:13:59.948668    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86"
Oct 30 21:14:00.609501 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.609466    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90"]
Oct 30 21:14:00.609853 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.609840    5937 cpu_manager.go:414] "containerMap: removing container" podUID="b7915b1e-faa2-494e-9d9b-82c497514b4b" containerName="curl"
Oct 30 21:14:00.609907 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.609855    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7915b1e-faa2-494e-9d9b-82c497514b4b" containerName="curl"
Oct 30 21:14:00.609945 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.609929    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7915b1e-faa2-494e-9d9b-82c497514b4b" containerName="curl"
Oct 30 21:14:00.612616 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.612601    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90"
Oct 30 21:14:00.622835 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.622818    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90"
Oct 30 21:14:00.668392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.668328    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90"]
Oct 30 21:14:00.821461 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.821431    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86"
Oct 30 21:14:00.821461 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.821450    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86" event={"ID":"b7915b1e-faa2-494e-9d9b-82c497514b4b","Type":"ContainerDied","Data":"9d18c7c5bf105920c667716f8f930fcd48634f0d5fae57fce898a7140bb321d6"}
Oct 30 21:14:00.821685 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.821489    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d18c7c5bf105920c667716f8f930fcd48634f0d5fae57fce898a7140bb321d6"
Oct 30 21:14:00.993609 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:00.993399    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90"]
Oct 30 21:14:00.996095 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:14:00.996067    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6004ebc_9113_4142_be1e_1415e528c35c.slice/crio-18189ad3bba89f0d130605cac5ea0a3151db14c65c5166258f62da4ef679e3f3 WatchSource:0}: Error finding container 18189ad3bba89f0d130605cac5ea0a3151db14c65c5166258f62da4ef679e3f3: Status 404 returned error can't find the container with id 18189ad3bba89f0d130605cac5ea0a3151db14c65c5166258f62da4ef679e3f3
Oct 30 21:14:01.827729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:01.827688    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90" event={"ID":"e6004ebc-9113-4142-be1e-1415e528c35c","Type":"ContainerStarted","Data":"a0c08bf3eb8154720f2243ff6c4b35490415b8b14964f1f5eb93df88b16d8267"}
Oct 30 21:14:01.827729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:01.827734    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90" event={"ID":"e6004ebc-9113-4142-be1e-1415e528c35c","Type":"ContainerStarted","Data":"18189ad3bba89f0d130605cac5ea0a3151db14c65c5166258f62da4ef679e3f3"}
Oct 30 21:14:01.944652 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:01.944596    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90" podStartSLOduration=1.94458197 podStartE2EDuration="1.94458197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:01.943852779 +0000 UTC m=+2216.899867562" watchObservedRunningTime="2026-10-30 21:14:01.94458197 +0000 UTC m=+2216.900596740"
Oct 30 21:14:08.859658 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:08.859573    5937 generic.go:356] "Generic (PLEG): container finished" podID="e6004ebc-9113-4142-be1e-1415e528c35c" containerID="a0c08bf3eb8154720f2243ff6c4b35490415b8b14964f1f5eb93df88b16d8267" exitCode=0
Oct 30 21:14:08.860007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:08.859648    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90" event={"ID":"e6004ebc-9113-4142-be1e-1415e528c35c","Type":"ContainerDied","Data":"a0c08bf3eb8154720f2243ff6c4b35490415b8b14964f1f5eb93df88b16d8267"}
Oct 30 21:14:09.991051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:09.991028    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90"
Oct 30 21:14:10.844393 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.844356    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761"]
Oct 30 21:14:10.844849 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.844832    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e6004ebc-9113-4142-be1e-1415e528c35c" containerName="curl"
Oct 30 21:14:10.844959 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.844850    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6004ebc-9113-4142-be1e-1415e528c35c" containerName="curl"
Oct 30 21:14:10.844959 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.844940    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6004ebc-9113-4142-be1e-1415e528c35c" containerName="curl"
Oct 30 21:14:10.847857 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.847837    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761"
Oct 30 21:14:10.858253 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.858233    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761"
Oct 30 21:14:10.868881 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.868863    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90"
Oct 30 21:14:10.868971 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.868899    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90" event={"ID":"e6004ebc-9113-4142-be1e-1415e528c35c","Type":"ContainerDied","Data":"18189ad3bba89f0d130605cac5ea0a3151db14c65c5166258f62da4ef679e3f3"}
Oct 30 21:14:10.868971 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.868935    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18189ad3bba89f0d130605cac5ea0a3151db14c65c5166258f62da4ef679e3f3"
Oct 30 21:14:10.904271 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:10.904216    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761"]
Oct 30 21:14:11.229077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:11.229052    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761"]
Oct 30 21:14:11.231825 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:14:11.231803    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd90af14c_80ca_4045_8169_94e27843da74.slice/crio-916cc3678ec9a353ddc409d131b30b2197eaf282b0d064cb10ab59262a5f4917 WatchSource:0}: Error finding container 916cc3678ec9a353ddc409d131b30b2197eaf282b0d064cb10ab59262a5f4917: Status 404 returned error can't find the container with id 916cc3678ec9a353ddc409d131b30b2197eaf282b0d064cb10ab59262a5f4917
Oct 30 21:14:11.874334 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:11.874296    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761" event={"ID":"d90af14c-80ca-4045-8169-94e27843da74","Type":"ContainerStarted","Data":"522f3f1d3de691e6fc19f8a833ff9915003b0da2550bf5c58019cc56feaa0f9d"}
Oct 30 21:14:11.874334 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:11.874335    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761" event={"ID":"d90af14c-80ca-4045-8169-94e27843da74","Type":"ContainerStarted","Data":"916cc3678ec9a353ddc409d131b30b2197eaf282b0d064cb10ab59262a5f4917"}
Oct 30 21:14:11.990628 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:11.990567    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761" podStartSLOduration=1.9905494620000002 podStartE2EDuration="1.990549462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:11.989957699 +0000 UTC m=+2226.945972475" watchObservedRunningTime="2026-10-30 21:14:11.990549462 +0000 UTC m=+2226.946564230"
Oct 30 21:14:14.939599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:14.939567    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"]
Oct 30 21:14:14.940059 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:14.939784    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf" podUID="11128895-840e-40f4-acdd-9dd7fbf90684" containerName="ta-container" containerID="cri-o://607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2" gracePeriod=30
Oct 30 21:14:15.186095 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.186072    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:14:15.212294 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.212272    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/11128895-840e-40f4-acdd-9dd7fbf90684-kube-api-access-k466l\" (UniqueName: \"kubernetes.io/projected/11128895-840e-40f4-acdd-9dd7fbf90684-kube-api-access-k466l\") pod \"11128895-840e-40f4-acdd-9dd7fbf90684\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") "
Oct 30 21:14:15.212400 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.212333    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/11128895-840e-40f4-acdd-9dd7fbf90684-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/11128895-840e-40f4-acdd-9dd7fbf90684-data-science-collector-ta-server-cert\") pod \"11128895-840e-40f4-acdd-9dd7fbf90684\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") "
Oct 30 21:14:15.212400 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.212370    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/11128895-840e-40f4-acdd-9dd7fbf90684-ta-internal\" (UniqueName: \"kubernetes.io/configmap/11128895-840e-40f4-acdd-9dd7fbf90684-ta-internal\") pod \"11128895-840e-40f4-acdd-9dd7fbf90684\" (UID: \"11128895-840e-40f4-acdd-9dd7fbf90684\") "
Oct 30 21:14:15.212840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.212813    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11128895-840e-40f4-acdd-9dd7fbf90684-ta-internal" pod "11128895-840e-40f4-acdd-9dd7fbf90684" (UID: "11128895-840e-40f4-acdd-9dd7fbf90684"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:14:15.214482 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.214462    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11128895-840e-40f4-acdd-9dd7fbf90684-data-science-collector-ta-server-cert" pod "11128895-840e-40f4-acdd-9dd7fbf90684" (UID: "11128895-840e-40f4-acdd-9dd7fbf90684"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:14:15.214579 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.214559    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11128895-840e-40f4-acdd-9dd7fbf90684-kube-api-access-k466l" pod "11128895-840e-40f4-acdd-9dd7fbf90684" (UID: "11128895-840e-40f4-acdd-9dd7fbf90684"). InnerVolumeSpecName "kube-api-access-k466l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:14:15.313960 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.313933    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k466l\" (UniqueName: \"kubernetes.io/projected/11128895-840e-40f4-acdd-9dd7fbf90684-kube-api-access-k466l\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:15.313960 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.313954    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/11128895-840e-40f4-acdd-9dd7fbf90684-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:15.314091 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.313965    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/11128895-840e-40f4-acdd-9dd7fbf90684-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:14:15.670836 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:14:15.670748    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:14:15.891575 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.891519    5937 generic.go:356] "Generic (PLEG): container finished" podID="11128895-840e-40f4-acdd-9dd7fbf90684" containerID="607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2" exitCode=0
Oct 30 21:14:15.891718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.891578    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf" event={"ID":"11128895-840e-40f4-acdd-9dd7fbf90684","Type":"ContainerDied","Data":"607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2"}
Oct 30 21:14:15.891718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.891598    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"
Oct 30 21:14:15.891718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.891624    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf" event={"ID":"11128895-840e-40f4-acdd-9dd7fbf90684","Type":"ContainerDied","Data":"2bd6949e751307d62954ef0d274931d682735a9da9ee84b75d12711edc4de213"}
Oct 30 21:14:15.891718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.891640    5937 scope.go:122] "RemoveContainer" containerID="607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2"
Oct 30 21:14:15.901056 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.901041    5937 scope.go:122] "RemoveContainer" containerID="607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2"
Oct 30 21:14:15.901298 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:14:15.901280    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2\": container with ID starting with 607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2 not found: ID does not exist" containerID="607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2"
Oct 30 21:14:15.901361 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:15.901308    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2"} err="failed to get container status \"607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2\": rpc error: code = NotFound desc = could not find container \"607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2\": container with ID starting with 607711d4ebe530f28307c73bd03a495287ef848b273f594b6d890a690591dfc2 not found: ID does not exist"
Oct 30 21:14:16.058919 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:16.058893    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"]
Oct 30 21:14:16.109392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:16.109365    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-9fd97858d-sqvgf"]
Oct 30 21:14:17.160424 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:17.160393    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="11128895-840e-40f4-acdd-9dd7fbf90684" path="/var/lib/kubelet/pods/11128895-840e-40f4-acdd-9dd7fbf90684/volumes"
Oct 30 21:14:18.907447 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:18.907424    5937 generic.go:356] "Generic (PLEG): container finished" podID="d90af14c-80ca-4045-8169-94e27843da74" containerID="522f3f1d3de691e6fc19f8a833ff9915003b0da2550bf5c58019cc56feaa0f9d" exitCode=0
Oct 30 21:14:18.907917 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:18.907456    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761" event={"ID":"d90af14c-80ca-4045-8169-94e27843da74","Type":"ContainerDied","Data":"522f3f1d3de691e6fc19f8a833ff9915003b0da2550bf5c58019cc56feaa0f9d"}
Oct 30 21:14:20.036249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:20.036225    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761"
Oct 30 21:14:20.917123 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:20.917090    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761"
Oct 30 21:14:20.917290 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:20.917141    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761" event={"ID":"d90af14c-80ca-4045-8169-94e27843da74","Type":"ContainerDied","Data":"916cc3678ec9a353ddc409d131b30b2197eaf282b0d064cb10ab59262a5f4917"}
Oct 30 21:14:20.917290 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:20.917177    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="916cc3678ec9a353ddc409d131b30b2197eaf282b0d064cb10ab59262a5f4917"
Oct 30 21:14:21.073659 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.073627    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623"]
Oct 30 21:14:21.074035 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.074022    5937 cpu_manager.go:414] "containerMap: removing container" podUID="d90af14c-80ca-4045-8169-94e27843da74" containerName="curl"
Oct 30 21:14:21.074077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.074039    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d90af14c-80ca-4045-8169-94e27843da74" containerName="curl"
Oct 30 21:14:21.074077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.074060    5937 cpu_manager.go:414] "containerMap: removing container" podUID="11128895-840e-40f4-acdd-9dd7fbf90684" containerName="ta-container"
Oct 30 21:14:21.074077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.074066    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="11128895-840e-40f4-acdd-9dd7fbf90684" containerName="ta-container"
Oct 30 21:14:21.074172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.074124    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="11128895-840e-40f4-acdd-9dd7fbf90684" containerName="ta-container"
Oct 30 21:14:21.074172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.074139    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="d90af14c-80ca-4045-8169-94e27843da74" containerName="curl"
Oct 30 21:14:21.077114 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.077099    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623"
Oct 30 21:14:21.088012 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.087994    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623"
Oct 30 21:14:21.133173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.133144    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623"]
Oct 30 21:14:21.457124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.457095    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623"]
Oct 30 21:14:21.460154 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:14:21.460130    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde698771_d2f2_44d1_9d82_4f891c3a349f.slice/crio-5283405a677d773c5ff6a517a32fec53df33e40b7f1af70e5722d3295d996f93 WatchSource:0}: Error finding container 5283405a677d773c5ff6a517a32fec53df33e40b7f1af70e5722d3295d996f93: Status 404 returned error can't find the container with id 5283405a677d773c5ff6a517a32fec53df33e40b7f1af70e5722d3295d996f93
Oct 30 21:14:21.922751 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.922661    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623" event={"ID":"de698771-d2f2-44d1-9d82-4f891c3a349f","Type":"ContainerStarted","Data":"d4221455c4c58f47795ed2d0ad61f6e110d28ce4c70748e5ee1c1db3c078ed29"}
Oct 30 21:14:21.922751 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:21.922714    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623" event={"ID":"de698771-d2f2-44d1-9d82-4f891c3a349f","Type":"ContainerStarted","Data":"5283405a677d773c5ff6a517a32fec53df33e40b7f1af70e5722d3295d996f93"}
Oct 30 21:14:22.039342 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:22.039297    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623" podStartSLOduration=1.03928527 podStartE2EDuration="1.03928527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:22.038598336 +0000 UTC m=+2236.994613113" watchObservedRunningTime="2026-10-30 21:14:22.03928527 +0000 UTC m=+2236.995300043"
Oct 30 21:14:29.959038 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:29.959009    5937 generic.go:356] "Generic (PLEG): container finished" podID="de698771-d2f2-44d1-9d82-4f891c3a349f" containerID="d4221455c4c58f47795ed2d0ad61f6e110d28ce4c70748e5ee1c1db3c078ed29" exitCode=0
Oct 30 21:14:29.959518 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:29.959087    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623" event={"ID":"de698771-d2f2-44d1-9d82-4f891c3a349f","Type":"ContainerDied","Data":"d4221455c4c58f47795ed2d0ad61f6e110d28ce4c70748e5ee1c1db3c078ed29"}
Oct 30 21:14:31.097834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:31.097808    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623"
Oct 30 21:14:31.969163 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:31.969132    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623" event={"ID":"de698771-d2f2-44d1-9d82-4f891c3a349f","Type":"ContainerDied","Data":"5283405a677d773c5ff6a517a32fec53df33e40b7f1af70e5722d3295d996f93"}
Oct 30 21:14:31.969163 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:31.969169    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5283405a677d773c5ff6a517a32fec53df33e40b7f1af70e5722d3295d996f93"
Oct 30 21:14:31.969371 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:31.969188    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623"
Oct 30 21:14:33.323099 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.323067    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf"]
Oct 30 21:14:33.323472 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.323429    5937 cpu_manager.go:414] "containerMap: removing container" podUID="de698771-d2f2-44d1-9d82-4f891c3a349f" containerName="curl"
Oct 30 21:14:33.323472 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.323441    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="de698771-d2f2-44d1-9d82-4f891c3a349f" containerName="curl"
Oct 30 21:14:33.323591 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.323555    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="de698771-d2f2-44d1-9d82-4f891c3a349f" containerName="curl"
Oct 30 21:14:33.326466 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.326451    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf"
Oct 30 21:14:33.337485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.337464    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf"
Oct 30 21:14:33.383416 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.383348    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf"]
Oct 30 21:14:33.706088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.706062    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf"]
Oct 30 21:14:33.709578 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:14:33.709551    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bf5bcad_8005_4499_a0d9_c51805cf57eb.slice/crio-d1e8a00a1e4d072b799514a0206f8a1b122b5a779322cc592a10920e5744723e WatchSource:0}: Error finding container d1e8a00a1e4d072b799514a0206f8a1b122b5a779322cc592a10920e5744723e: Status 404 returned error can't find the container with id d1e8a00a1e4d072b799514a0206f8a1b122b5a779322cc592a10920e5744723e
Oct 30 21:14:33.979403 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.979321    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf" event={"ID":"6bf5bcad-8005-4499-a0d9-c51805cf57eb","Type":"ContainerStarted","Data":"7dc27abb4fd9eaa1b7087772a592ccc161e7862c4e25aff332e2aee2e5544b28"}
Oct 30 21:14:33.979403 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:33.979367    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf" event={"ID":"6bf5bcad-8005-4499-a0d9-c51805cf57eb","Type":"ContainerStarted","Data":"d1e8a00a1e4d072b799514a0206f8a1b122b5a779322cc592a10920e5744723e"}
Oct 30 21:14:34.095063 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:34.095021    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf" podStartSLOduration=1.095008469 podStartE2EDuration="1.095008469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:34.094897503 +0000 UTC m=+2249.050912278" watchObservedRunningTime="2026-10-30 21:14:34.095008469 +0000 UTC m=+2249.051023257"
Oct 30 21:14:42.014591 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:42.014556    5937 generic.go:356] "Generic (PLEG): container finished" podID="6bf5bcad-8005-4499-a0d9-c51805cf57eb" containerID="7dc27abb4fd9eaa1b7087772a592ccc161e7862c4e25aff332e2aee2e5544b28" exitCode=0
Oct 30 21:14:42.014591 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:42.014593    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf" event={"ID":"6bf5bcad-8005-4499-a0d9-c51805cf57eb","Type":"ContainerDied","Data":"7dc27abb4fd9eaa1b7087772a592ccc161e7862c4e25aff332e2aee2e5544b28"}
Oct 30 21:14:43.152689 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:43.152666    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf"
Oct 30 21:14:43.558439 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:43.558409    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509"]
Oct 30 21:14:43.558791 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:43.558778    5937 cpu_manager.go:414] "containerMap: removing container" podUID="6bf5bcad-8005-4499-a0d9-c51805cf57eb" containerName="curl"
Oct 30 21:14:43.558839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:43.558792    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bf5bcad-8005-4499-a0d9-c51805cf57eb" containerName="curl"
Oct 30 21:14:43.558888 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:43.558875    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bf5bcad-8005-4499-a0d9-c51805cf57eb" containerName="curl"
Oct 30 21:14:43.561997 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:43.561980    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509"
Oct 30 21:14:43.572454 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:43.572437    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509"
Oct 30 21:14:43.618460 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:43.618424    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509"]
Oct 30 21:14:43.946176 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:43.946155    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509"]
Oct 30 21:14:43.948886 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:14:43.948857    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27f29007_9c6c_459a_8c88_fa4fe0d00363.slice/crio-01d36cef81ddcad88cc3c112a92f36bef28acb19f7b09ee90b7dfe52e31dd9ef WatchSource:0}: Error finding container 01d36cef81ddcad88cc3c112a92f36bef28acb19f7b09ee90b7dfe52e31dd9ef: Status 404 returned error can't find the container with id 01d36cef81ddcad88cc3c112a92f36bef28acb19f7b09ee90b7dfe52e31dd9ef
Oct 30 21:14:44.025810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:44.025787    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf"
Oct 30 21:14:44.025970 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:44.025821    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf" event={"ID":"6bf5bcad-8005-4499-a0d9-c51805cf57eb","Type":"ContainerDied","Data":"d1e8a00a1e4d072b799514a0206f8a1b122b5a779322cc592a10920e5744723e"}
Oct 30 21:14:44.025970 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:44.025864    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1e8a00a1e4d072b799514a0206f8a1b122b5a779322cc592a10920e5744723e"
Oct 30 21:14:44.027419 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:44.027394    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509" event={"ID":"27f29007-9c6c-459a-8c88-fa4fe0d00363","Type":"ContainerStarted","Data":"8fc63ff44e2902ac4177436778490008445e229565fca73500f3afa918669041"}
Oct 30 21:14:44.027638 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:44.027430    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509" event={"ID":"27f29007-9c6c-459a-8c88-fa4fe0d00363","Type":"ContainerStarted","Data":"01d36cef81ddcad88cc3c112a92f36bef28acb19f7b09ee90b7dfe52e31dd9ef"}
Oct 30 21:14:44.144462 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:44.144407    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509" podStartSLOduration=1.144391698 podStartE2EDuration="1.144391698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:44.143721811 +0000 UTC m=+2259.099736588" watchObservedRunningTime="2026-10-30 21:14:44.144391698 +0000 UTC m=+2259.100406473"
Oct 30 21:14:45.672029 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:14:45.671941    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:14:52.066985 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:52.066949    5937 generic.go:356] "Generic (PLEG): container finished" podID="27f29007-9c6c-459a-8c88-fa4fe0d00363" containerID="8fc63ff44e2902ac4177436778490008445e229565fca73500f3afa918669041" exitCode=0
Oct 30 21:14:52.067392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:52.067026    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509" event={"ID":"27f29007-9c6c-459a-8c88-fa4fe0d00363","Type":"ContainerDied","Data":"8fc63ff44e2902ac4177436778490008445e229565fca73500f3afa918669041"}
Oct 30 21:14:53.201288 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:53.201263    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509"
Oct 30 21:14:53.786793 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:53.786758    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24"]
Oct 30 21:14:53.787128 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:53.787115    5937 cpu_manager.go:414] "containerMap: removing container" podUID="27f29007-9c6c-459a-8c88-fa4fe0d00363" containerName="curl"
Oct 30 21:14:53.787171 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:53.787129    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27f29007-9c6c-459a-8c88-fa4fe0d00363" containerName="curl"
Oct 30 21:14:53.787229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:53.787196    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="27f29007-9c6c-459a-8c88-fa4fe0d00363" containerName="curl"
Oct 30 21:14:53.790133 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:53.790119    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24"
Oct 30 21:14:53.800446 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:53.800430    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24"
Oct 30 21:14:53.846605 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:53.846570    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24"]
Oct 30 21:14:54.076629 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:54.076528    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509" event={"ID":"27f29007-9c6c-459a-8c88-fa4fe0d00363","Type":"ContainerDied","Data":"01d36cef81ddcad88cc3c112a92f36bef28acb19f7b09ee90b7dfe52e31dd9ef"}
Oct 30 21:14:54.076629 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:54.076564    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509"
Oct 30 21:14:54.076629 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:54.076587    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01d36cef81ddcad88cc3c112a92f36bef28acb19f7b09ee90b7dfe52e31dd9ef"
Oct 30 21:14:54.170561 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:54.170523    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24"]
Oct 30 21:14:54.173076 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:14:54.173052    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78741f44_0507_48dd_af24_3310a587959a.slice/crio-f616a6987f236364afec2f01466f49d3cb7e4fdff7ec6e0484108438d5190ef1 WatchSource:0}: Error finding container f616a6987f236364afec2f01466f49d3cb7e4fdff7ec6e0484108438d5190ef1: Status 404 returned error can't find the container with id f616a6987f236364afec2f01466f49d3cb7e4fdff7ec6e0484108438d5190ef1
Oct 30 21:14:55.082920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:55.082881    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24" event={"ID":"78741f44-0507-48dd-af24-3310a587959a","Type":"ContainerStarted","Data":"f6ef683cfd9a15ddd36b4ab511fde6071788923f2187c73d621043dd4946d48c"}
Oct 30 21:14:55.082920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:55.082926    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24" event={"ID":"78741f44-0507-48dd-af24-3310a587959a","Type":"ContainerStarted","Data":"f616a6987f236364afec2f01466f49d3cb7e4fdff7ec6e0484108438d5190ef1"}
Oct 30 21:14:55.199746 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:14:55.199692    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24" podStartSLOduration=2.199676871 podStartE2EDuration="2.199676871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:14:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:14:55.198186493 +0000 UTC m=+2270.154201280" watchObservedRunningTime="2026-10-30 21:14:55.199676871 +0000 UTC m=+2270.155691647"
Oct 30 21:15:02.119553 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:02.119438    5937 generic.go:356] "Generic (PLEG): container finished" podID="78741f44-0507-48dd-af24-3310a587959a" containerID="f6ef683cfd9a15ddd36b4ab511fde6071788923f2187c73d621043dd4946d48c" exitCode=0
Oct 30 21:15:02.119553 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:02.119515    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24" event={"ID":"78741f44-0507-48dd-af24-3310a587959a","Type":"ContainerDied","Data":"f6ef683cfd9a15ddd36b4ab511fde6071788923f2187c73d621043dd4946d48c"}
Oct 30 21:15:03.257305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:03.257279    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24"
Oct 30 21:15:04.017458 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.017420    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493"]
Oct 30 21:15:04.018045 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.018028    5937 cpu_manager.go:414] "containerMap: removing container" podUID="78741f44-0507-48dd-af24-3310a587959a" containerName="curl"
Oct 30 21:15:04.018091 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.018048    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="78741f44-0507-48dd-af24-3310a587959a" containerName="curl"
Oct 30 21:15:04.018163 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.018153    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="78741f44-0507-48dd-af24-3310a587959a" containerName="curl"
Oct 30 21:15:04.021358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.021343    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493"
Oct 30 21:15:04.032242 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.032221    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493"
Oct 30 21:15:04.076854 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.076824    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493"]
Oct 30 21:15:04.130161 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.130134    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24" event={"ID":"78741f44-0507-48dd-af24-3310a587959a","Type":"ContainerDied","Data":"f616a6987f236364afec2f01466f49d3cb7e4fdff7ec6e0484108438d5190ef1"}
Oct 30 21:15:04.130294 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.130170    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f616a6987f236364afec2f01466f49d3cb7e4fdff7ec6e0484108438d5190ef1"
Oct 30 21:15:04.130294 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.130172    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24"
Oct 30 21:15:04.404765 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:04.404346    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493"]
Oct 30 21:15:04.407406 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:15:04.407381    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod412be3c9_8e26_494c_b6fa_cb15535947f7.slice/crio-746ca828b40922de59c72c6ab76a28478f8155d513717c97ad47c4cb39945557 WatchSource:0}: Error finding container 746ca828b40922de59c72c6ab76a28478f8155d513717c97ad47c4cb39945557: Status 404 returned error can't find the container with id 746ca828b40922de59c72c6ab76a28478f8155d513717c97ad47c4cb39945557
Oct 30 21:15:05.136729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:05.136694    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493" event={"ID":"412be3c9-8e26-494c-b6fa-cb15535947f7","Type":"ContainerStarted","Data":"3053d2bd08a2043e655f8faeb1d822a3653944fbdfa1ff747f941129380839a6"}
Oct 30 21:15:05.136729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:05.136734    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493" event={"ID":"412be3c9-8e26-494c-b6fa-cb15535947f7","Type":"ContainerStarted","Data":"746ca828b40922de59c72c6ab76a28478f8155d513717c97ad47c4cb39945557"}
Oct 30 21:15:12.169037 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:12.169002    5937 generic.go:356] "Generic (PLEG): container finished" podID="412be3c9-8e26-494c-b6fa-cb15535947f7" containerID="3053d2bd08a2043e655f8faeb1d822a3653944fbdfa1ff747f941129380839a6" exitCode=0
Oct 30 21:15:12.169439 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:12.169074    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493" event={"ID":"412be3c9-8e26-494c-b6fa-cb15535947f7","Type":"ContainerDied","Data":"3053d2bd08a2043e655f8faeb1d822a3653944fbdfa1ff747f941129380839a6"}
Oct 30 21:15:13.318296 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:13.318267    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493"
Oct 30 21:15:14.178484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.178454    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493"
Oct 30 21:15:14.178674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.178452    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493" event={"ID":"412be3c9-8e26-494c-b6fa-cb15535947f7","Type":"ContainerDied","Data":"746ca828b40922de59c72c6ab76a28478f8155d513717c97ad47c4cb39945557"}
Oct 30 21:15:14.178674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.178574    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="746ca828b40922de59c72c6ab76a28478f8155d513717c97ad47c4cb39945557"
Oct 30 21:15:14.251248 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.251221    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a"]
Oct 30 21:15:14.251692 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.251675    5937 cpu_manager.go:414] "containerMap: removing container" podUID="412be3c9-8e26-494c-b6fa-cb15535947f7" containerName="curl"
Oct 30 21:15:14.251801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.251693    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="412be3c9-8e26-494c-b6fa-cb15535947f7" containerName="curl"
Oct 30 21:15:14.251860 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.251802    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="412be3c9-8e26-494c-b6fa-cb15535947f7" containerName="curl"
Oct 30 21:15:14.254798 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.254779    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a"
Oct 30 21:15:14.265298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.265282    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a"
Oct 30 21:15:14.309275 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.309249    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a"]
Oct 30 21:15:14.634909 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:14.634753    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a"]
Oct 30 21:15:14.637832 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:15:14.637808    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac870c9a_fee6_48c4_8b5f_f3367b0a832c.slice/crio-a1c6438798e8ec642254b3cf9e9407e01678e2e63b5de32e715d82230cd741d4 WatchSource:0}: Error finding container a1c6438798e8ec642254b3cf9e9407e01678e2e63b5de32e715d82230cd741d4: Status 404 returned error can't find the container with id a1c6438798e8ec642254b3cf9e9407e01678e2e63b5de32e715d82230cd741d4
Oct 30 21:15:15.184289 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:15.184253    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a" event={"ID":"ac870c9a-fee6-48c4-8b5f-f3367b0a832c","Type":"ContainerStarted","Data":"fda56bcc30752d9df895ce57cf6b1d6e1f21fd7d0f73611b0a5b68a13862084b"}
Oct 30 21:15:15.184289 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:15.184289    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a" event={"ID":"ac870c9a-fee6-48c4-8b5f-f3367b0a832c","Type":"ContainerStarted","Data":"a1c6438798e8ec642254b3cf9e9407e01678e2e63b5de32e715d82230cd741d4"}
Oct 30 21:15:15.301345 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:15.301292    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a" podStartSLOduration=1.301278412 podStartE2EDuration="1.301278412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:15:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:15:15.300775049 +0000 UTC m=+2290.256789826" watchObservedRunningTime="2026-10-30 21:15:15.301278412 +0000 UTC m=+2290.257293185"
Oct 30 21:15:15.672187 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:15:15.672141    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:15:23.218760 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:23.218728    5937 generic.go:356] "Generic (PLEG): container finished" podID="ac870c9a-fee6-48c4-8b5f-f3367b0a832c" containerID="fda56bcc30752d9df895ce57cf6b1d6e1f21fd7d0f73611b0a5b68a13862084b" exitCode=0
Oct 30 21:15:23.219133 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:23.218801    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a" event={"ID":"ac870c9a-fee6-48c4-8b5f-f3367b0a832c","Type":"ContainerDied","Data":"fda56bcc30752d9df895ce57cf6b1d6e1f21fd7d0f73611b0a5b68a13862084b"}
Oct 30 21:15:24.351412 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:24.351388    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a"
Oct 30 21:15:25.228361 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:25.228324    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a" event={"ID":"ac870c9a-fee6-48c4-8b5f-f3367b0a832c","Type":"ContainerDied","Data":"a1c6438798e8ec642254b3cf9e9407e01678e2e63b5de32e715d82230cd741d4"}
Oct 30 21:15:25.228361 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:25.228352    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a"
Oct 30 21:15:25.228361 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:25.228364    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1c6438798e8ec642254b3cf9e9407e01678e2e63b5de32e715d82230cd741d4"
Oct 30 21:15:26.506084 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:26.506052    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b"]
Oct 30 21:15:26.506444 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:26.506413    5937 cpu_manager.go:414] "containerMap: removing container" podUID="ac870c9a-fee6-48c4-8b5f-f3367b0a832c" containerName="curl"
Oct 30 21:15:26.506444 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:26.506423    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac870c9a-fee6-48c4-8b5f-f3367b0a832c" containerName="curl"
Oct 30 21:15:26.506528 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:26.506486    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac870c9a-fee6-48c4-8b5f-f3367b0a832c" containerName="curl"
Oct 30 21:15:26.509285 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:26.509268    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b"
Oct 30 21:15:26.519759 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:26.519743    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b"
Oct 30 21:15:26.566395 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:26.566362    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b"]
Oct 30 21:15:26.893770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:26.893589    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b"]
Oct 30 21:15:26.896284 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:15:26.896255    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0a6a195_489a_44b2_bd6f_366f465cb5f0.slice/crio-9053b9701b4f0e2d048fefc054e850c9f25dfcb6e8b17209f85015194526fdb1 WatchSource:0}: Error finding container 9053b9701b4f0e2d048fefc054e850c9f25dfcb6e8b17209f85015194526fdb1: Status 404 returned error can't find the container with id 9053b9701b4f0e2d048fefc054e850c9f25dfcb6e8b17209f85015194526fdb1
Oct 30 21:15:27.238827 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:27.238791    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b" event={"ID":"e0a6a195-489a-44b2-bd6f-366f465cb5f0","Type":"ContainerStarted","Data":"10b6ee3b555e85f9adef9032c4ed6f28131e0ae3345e6324e2fcd1569c562370"}
Oct 30 21:15:27.238827 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:27.238828    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b" event={"ID":"e0a6a195-489a-44b2-bd6f-366f465cb5f0","Type":"ContainerStarted","Data":"9053b9701b4f0e2d048fefc054e850c9f25dfcb6e8b17209f85015194526fdb1"}
Oct 30 21:15:27.355101 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:27.355053    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b" podStartSLOduration=1.355040072 podStartE2EDuration="1.355040072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:15:27.354459232 +0000 UTC m=+2302.310474011" watchObservedRunningTime="2026-10-30 21:15:27.355040072 +0000 UTC m=+2302.311054845"
Oct 30 21:15:35.274767 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:35.274727    5937 generic.go:356] "Generic (PLEG): container finished" podID="e0a6a195-489a-44b2-bd6f-366f465cb5f0" containerID="10b6ee3b555e85f9adef9032c4ed6f28131e0ae3345e6324e2fcd1569c562370" exitCode=0
Oct 30 21:15:35.275211 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:35.274797    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b" event={"ID":"e0a6a195-489a-44b2-bd6f-366f465cb5f0","Type":"ContainerDied","Data":"10b6ee3b555e85f9adef9032c4ed6f28131e0ae3345e6324e2fcd1569c562370"}
Oct 30 21:15:36.423236 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:36.423214    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b"
Oct 30 21:15:36.736861 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:36.736835    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94"]
Oct 30 21:15:36.737197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:36.737184    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e0a6a195-489a-44b2-bd6f-366f465cb5f0" containerName="curl"
Oct 30 21:15:36.737248 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:36.737198    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0a6a195-489a-44b2-bd6f-366f465cb5f0" containerName="curl"
Oct 30 21:15:36.737285 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:36.737272    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0a6a195-489a-44b2-bd6f-366f465cb5f0" containerName="curl"
Oct 30 21:15:36.740140 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:36.740126    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94"
Oct 30 21:15:36.750464 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:36.750446    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94"
Oct 30 21:15:36.797332 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:36.797294    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94"]
Oct 30 21:15:37.119968 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:37.119811    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94"]
Oct 30 21:15:37.122703 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:15:37.122669    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf74da29c_16db_40e5_8e3d_2e354a98adca.slice/crio-a18936b4467d84d69d05a24c95798255dc72dea7c4155a9c006c8cfbb64ffc14 WatchSource:0}: Error finding container a18936b4467d84d69d05a24c95798255dc72dea7c4155a9c006c8cfbb64ffc14: Status 404 returned error can't find the container with id a18936b4467d84d69d05a24c95798255dc72dea7c4155a9c006c8cfbb64ffc14
Oct 30 21:15:37.285035 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:37.285003    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94" event={"ID":"f74da29c-16db-40e5-8e3d-2e354a98adca","Type":"ContainerStarted","Data":"a789a8fb368be7093a4f3a84251e3459b1d6b6b9aa6bb8185f444730782b8d41"}
Oct 30 21:15:37.285207 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:37.285046    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94" event={"ID":"f74da29c-16db-40e5-8e3d-2e354a98adca","Type":"ContainerStarted","Data":"a18936b4467d84d69d05a24c95798255dc72dea7c4155a9c006c8cfbb64ffc14"}
Oct 30 21:15:37.286249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:37.286228    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b"
Oct 30 21:15:37.286342 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:37.286260    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b" event={"ID":"e0a6a195-489a-44b2-bd6f-366f465cb5f0","Type":"ContainerDied","Data":"9053b9701b4f0e2d048fefc054e850c9f25dfcb6e8b17209f85015194526fdb1"}
Oct 30 21:15:37.286342 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:37.286287    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9053b9701b4f0e2d048fefc054e850c9f25dfcb6e8b17209f85015194526fdb1"
Oct 30 21:15:37.401003 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:37.400911    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94" podStartSLOduration=1.400893084 podStartE2EDuration="1.400893084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:15:37.400221151 +0000 UTC m=+2312.356235930" watchObservedRunningTime="2026-10-30 21:15:37.400893084 +0000 UTC m=+2312.356907862"
Oct 30 21:15:45.331801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:45.331768    5937 generic.go:356] "Generic (PLEG): container finished" podID="f74da29c-16db-40e5-8e3d-2e354a98adca" containerID="a789a8fb368be7093a4f3a84251e3459b1d6b6b9aa6bb8185f444730782b8d41" exitCode=0
Oct 30 21:15:45.331801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:45.331809    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94" event={"ID":"f74da29c-16db-40e5-8e3d-2e354a98adca","Type":"ContainerDied","Data":"a789a8fb368be7093a4f3a84251e3459b1d6b6b9aa6bb8185f444730782b8d41"}
Oct 30 21:15:45.671931 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:15:45.671853    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:15:46.468357 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:46.468333    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94"
Oct 30 21:15:46.957081 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:46.957056    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55"]
Oct 30 21:15:46.957463 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:46.957451    5937 cpu_manager.go:414] "containerMap: removing container" podUID="f74da29c-16db-40e5-8e3d-2e354a98adca" containerName="curl"
Oct 30 21:15:46.957507 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:46.957465    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f74da29c-16db-40e5-8e3d-2e354a98adca" containerName="curl"
Oct 30 21:15:46.957557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:46.957519    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="f74da29c-16db-40e5-8e3d-2e354a98adca" containerName="curl"
Oct 30 21:15:46.960577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:46.960561    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55"
Oct 30 21:15:46.971393 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:46.971374    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55"
Oct 30 21:15:47.016938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:47.016853    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55"]
Oct 30 21:15:47.342104 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:47.342024    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55"]
Oct 30 21:15:47.345134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:47.345100    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94" event={"ID":"f74da29c-16db-40e5-8e3d-2e354a98adca","Type":"ContainerDied","Data":"a18936b4467d84d69d05a24c95798255dc72dea7c4155a9c006c8cfbb64ffc14"}
Oct 30 21:15:47.345134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:47.345131    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94"
Oct 30 21:15:47.345327 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:47.345179    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a18936b4467d84d69d05a24c95798255dc72dea7c4155a9c006c8cfbb64ffc14"
Oct 30 21:15:47.345729 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:15:47.345710    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf87abb32_b240_4e24_979b_e8d2c5c25ca5.slice/crio-9efd8e352004878a4acf82de936baca3a97dd2989f31d8ede4cb820d7d9038ed WatchSource:0}: Error finding container 9efd8e352004878a4acf82de936baca3a97dd2989f31d8ede4cb820d7d9038ed: Status 404 returned error can't find the container with id 9efd8e352004878a4acf82de936baca3a97dd2989f31d8ede4cb820d7d9038ed
Oct 30 21:15:48.351394 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:48.351361    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55" event={"ID":"f87abb32-b240-4e24-979b-e8d2c5c25ca5","Type":"ContainerStarted","Data":"411e9eb6b7253b9a10a2ea801da1c43a468d18f20ce5d09b9fdeb105a42e0db5"}
Oct 30 21:15:48.351906 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:48.351403    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55" event={"ID":"f87abb32-b240-4e24-979b-e8d2c5c25ca5","Type":"ContainerStarted","Data":"9efd8e352004878a4acf82de936baca3a97dd2989f31d8ede4cb820d7d9038ed"}
Oct 30 21:15:48.468492 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:48.468433    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55" podStartSLOduration=2.468419329 podStartE2EDuration="2.468419329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:15:48.467460519 +0000 UTC m=+2323.423475296" watchObservedRunningTime="2026-10-30 21:15:48.468419329 +0000 UTC m=+2323.424434102"
Oct 30 21:15:55.384720 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:55.384682    5937 generic.go:356] "Generic (PLEG): container finished" podID="f87abb32-b240-4e24-979b-e8d2c5c25ca5" containerID="411e9eb6b7253b9a10a2ea801da1c43a468d18f20ce5d09b9fdeb105a42e0db5" exitCode=0
Oct 30 21:15:55.385179 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:55.384756    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55" event={"ID":"f87abb32-b240-4e24-979b-e8d2c5c25ca5","Type":"ContainerDied","Data":"411e9eb6b7253b9a10a2ea801da1c43a468d18f20ce5d09b9fdeb105a42e0db5"}
Oct 30 21:15:56.525491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:56.525469    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55"
Oct 30 21:15:57.174725 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.174698    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3"]
Oct 30 21:15:57.175065 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.175053    5937 cpu_manager.go:414] "containerMap: removing container" podUID="f87abb32-b240-4e24-979b-e8d2c5c25ca5" containerName="curl"
Oct 30 21:15:57.175102 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.175067    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f87abb32-b240-4e24-979b-e8d2c5c25ca5" containerName="curl"
Oct 30 21:15:57.175146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.175129    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="f87abb32-b240-4e24-979b-e8d2c5c25ca5" containerName="curl"
Oct 30 21:15:57.178071 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.178055    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3"
Oct 30 21:15:57.188488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.188466    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3"
Oct 30 21:15:57.234570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.234505    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3"]
Oct 30 21:15:57.395830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.395793    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55" event={"ID":"f87abb32-b240-4e24-979b-e8d2c5c25ca5","Type":"ContainerDied","Data":"9efd8e352004878a4acf82de936baca3a97dd2989f31d8ede4cb820d7d9038ed"}
Oct 30 21:15:57.395830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.395833    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9efd8e352004878a4acf82de936baca3a97dd2989f31d8ede4cb820d7d9038ed"
Oct 30 21:15:57.396060 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.395854    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55"
Oct 30 21:15:57.566710 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:57.566494    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3"]
Oct 30 21:15:57.569201 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:15:57.569164    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3fc4a1a_fdce_4e22_b847_bb6f06fe46a5.slice/crio-1642e4583a6898b38474065c053dd8ba16b1d50c887faedf15a7d557f0dad4cb WatchSource:0}: Error finding container 1642e4583a6898b38474065c053dd8ba16b1d50c887faedf15a7d557f0dad4cb: Status 404 returned error can't find the container with id 1642e4583a6898b38474065c053dd8ba16b1d50c887faedf15a7d557f0dad4cb
Oct 30 21:15:58.401625 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:58.401588    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3" event={"ID":"b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5","Type":"ContainerStarted","Data":"ca61e6976bd1ee00cb53ce5fd52aaa77c24f17990a369316513bb2c3f0b75cd2"}
Oct 30 21:15:58.401796 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:58.401634    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3" event={"ID":"b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5","Type":"ContainerStarted","Data":"1642e4583a6898b38474065c053dd8ba16b1d50c887faedf15a7d557f0dad4cb"}
Oct 30 21:15:58.517988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:15:58.517923    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3" podStartSLOduration=1.5179042200000001 podStartE2EDuration="1.51790422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:15:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:15:58.517685267 +0000 UTC m=+2333.473700035" watchObservedRunningTime="2026-10-30 21:15:58.51790422 +0000 UTC m=+2333.473918996"
Oct 30 21:16:05.437186 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:05.437097    5937 generic.go:356] "Generic (PLEG): container finished" podID="b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5" containerID="ca61e6976bd1ee00cb53ce5fd52aaa77c24f17990a369316513bb2c3f0b75cd2" exitCode=0
Oct 30 21:16:05.437186 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:05.437171    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3" event={"ID":"b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5","Type":"ContainerDied","Data":"ca61e6976bd1ee00cb53ce5fd52aaa77c24f17990a369316513bb2c3f0b75cd2"}
Oct 30 21:16:06.574814 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:06.574791    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3"
Oct 30 21:16:07.425413 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.425339    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e"]
Oct 30 21:16:07.425756 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.425744    5937 cpu_manager.go:414] "containerMap: removing container" podUID="b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5" containerName="curl"
Oct 30 21:16:07.425805 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.425758    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5" containerName="curl"
Oct 30 21:16:07.425841 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.425826    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5" containerName="curl"
Oct 30 21:16:07.428745 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.428728    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e"
Oct 30 21:16:07.449129 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.449109    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3"
Oct 30 21:16:07.449286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.449133    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3" event={"ID":"b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5","Type":"ContainerDied","Data":"1642e4583a6898b38474065c053dd8ba16b1d50c887faedf15a7d557f0dad4cb"}
Oct 30 21:16:07.449286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.449167    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1642e4583a6898b38474065c053dd8ba16b1d50c887faedf15a7d557f0dad4cb"
Oct 30 21:16:07.485242 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.485217    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e"]
Oct 30 21:16:07.534193 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.534165    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e36b1b0258a256\"/\"default-dockercfg-jpw68\""
Oct 30 21:16:07.540281 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.540262    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e"
Oct 30 21:16:07.915677 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:07.915634    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e"]
Oct 30 21:16:07.918168 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:07.918146    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddebc4eb2_aebc_4724_aebb_42ce22a17a57.slice/crio-26b411facd20bc04c21a743a1468043e04a8bf2f6bfdd6f239a961dccb1dfb31 WatchSource:0}: Error finding container 26b411facd20bc04c21a743a1468043e04a8bf2f6bfdd6f239a961dccb1dfb31: Status 404 returned error can't find the container with id 26b411facd20bc04c21a743a1468043e04a8bf2f6bfdd6f239a961dccb1dfb31
Oct 30 21:16:08.455837 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:08.455802    5937 generic.go:356] "Generic (PLEG): container finished" podID="debc4eb2-aebc-4724-aebb-42ce22a17a57" containerID="f390c3cd8c8c3ac20c511a4d84724cf7fcf15f0449d726fc93ef6b9d9d7c9773" exitCode=0
Oct 30 21:16:08.455837 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:08.455837    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e" event={"ID":"debc4eb2-aebc-4724-aebb-42ce22a17a57","Type":"ContainerDied","Data":"f390c3cd8c8c3ac20c511a4d84724cf7fcf15f0449d726fc93ef6b9d9d7c9773"}
Oct 30 21:16:08.456056 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:08.455863    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e" event={"ID":"debc4eb2-aebc-4724-aebb-42ce22a17a57","Type":"ContainerStarted","Data":"26b411facd20bc04c21a743a1468043e04a8bf2f6bfdd6f239a961dccb1dfb31"}
Oct 30 21:16:09.595718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:09.595696    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e"
Oct 30 21:16:10.467254 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:10.467223    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e" event={"ID":"debc4eb2-aebc-4724-aebb-42ce22a17a57","Type":"ContainerDied","Data":"26b411facd20bc04c21a743a1468043e04a8bf2f6bfdd6f239a961dccb1dfb31"}
Oct 30 21:16:10.467254 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:10.467261    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26b411facd20bc04c21a743a1468043e04a8bf2f6bfdd6f239a961dccb1dfb31"
Oct 30 21:16:10.467464 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:10.467261    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e"
Oct 30 21:16:11.604757 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:11.604722    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52"]
Oct 30 21:16:11.605172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:11.605157    5937 cpu_manager.go:414] "containerMap: removing container" podUID="debc4eb2-aebc-4724-aebb-42ce22a17a57" containerName="curl"
Oct 30 21:16:11.605215 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:11.605173    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="debc4eb2-aebc-4724-aebb-42ce22a17a57" containerName="curl"
Oct 30 21:16:11.605255 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:11.605246    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="debc4eb2-aebc-4724-aebb-42ce22a17a57" containerName="curl"
Oct 30 21:16:11.608245 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:11.608230    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52"
Oct 30 21:16:11.662725 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:11.662699    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e36b1b0258a256\"/\"default-dockercfg-jpw68\""
Oct 30 21:16:11.668884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:11.668859    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52"
Oct 30 21:16:11.714811 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:11.714783    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52"]
Oct 30 21:16:12.043449 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:12.043429    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52"]
Oct 30 21:16:12.045911 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:12.045884    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode78c1e56_04dd_410e_9a61_80b0fe4ca9d9.slice/crio-558595a26222fc740088e545cfb31f202bf06909d77c8110fee9cc21e898465c WatchSource:0}: Error finding container 558595a26222fc740088e545cfb31f202bf06909d77c8110fee9cc21e898465c: Status 404 returned error can't find the container with id 558595a26222fc740088e545cfb31f202bf06909d77c8110fee9cc21e898465c
Oct 30 21:16:12.477361 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:12.477332    5937 generic.go:356] "Generic (PLEG): container finished" podID="e78c1e56-04dd-410e-9a61-80b0fe4ca9d9" containerID="2f4e423d2e135f670c8095ce5c973d60e2784e5d60a9f747979bf1ffac811124" exitCode=0
Oct 30 21:16:12.477575 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:12.477415    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52" event={"ID":"e78c1e56-04dd-410e-9a61-80b0fe4ca9d9","Type":"ContainerDied","Data":"2f4e423d2e135f670c8095ce5c973d60e2784e5d60a9f747979bf1ffac811124"}
Oct 30 21:16:12.477575 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:12.477450    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52" event={"ID":"e78c1e56-04dd-410e-9a61-80b0fe4ca9d9","Type":"ContainerStarted","Data":"558595a26222fc740088e545cfb31f202bf06909d77c8110fee9cc21e898465c"}
Oct 30 21:16:13.618353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:13.618329    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52"
Oct 30 21:16:14.489060 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:14.488986    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52"
Oct 30 21:16:14.489060 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:14.489026    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52" event={"ID":"e78c1e56-04dd-410e-9a61-80b0fe4ca9d9","Type":"ContainerDied","Data":"558595a26222fc740088e545cfb31f202bf06909d77c8110fee9cc21e898465c"}
Oct 30 21:16:14.489060 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:14.489062    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="558595a26222fc740088e545cfb31f202bf06909d77c8110fee9cc21e898465c"
Oct 30 21:16:15.671757 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:16:15.671718    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:16:15.785991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:15.785961    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771"]
Oct 30 21:16:15.786350 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:15.786338    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e78c1e56-04dd-410e-9a61-80b0fe4ca9d9" containerName="curl"
Oct 30 21:16:15.786389 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:15.786351    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e78c1e56-04dd-410e-9a61-80b0fe4ca9d9" containerName="curl"
Oct 30 21:16:15.786436 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:15.786424    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e78c1e56-04dd-410e-9a61-80b0fe4ca9d9" containerName="curl"
Oct 30 21:16:15.789402 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:15.789389    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771"
Oct 30 21:16:15.845427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:15.845389    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e36b1b0258a256\"/\"default-dockercfg-jpw68\""
Oct 30 21:16:15.850919 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:15.850900    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771"
Oct 30 21:16:15.897154 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:15.897124    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771"]
Oct 30 21:16:16.224590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:16.224413    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771"]
Oct 30 21:16:16.227414 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:16.227387    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf3c29d2_0c79_465d_a4a0_82c898c55c75.slice/crio-5935b8bf464296de6d1a40f6aa1c4347a4d4d55ccaa7bd6f3356ed14ad5026f4 WatchSource:0}: Error finding container 5935b8bf464296de6d1a40f6aa1c4347a4d4d55ccaa7bd6f3356ed14ad5026f4: Status 404 returned error can't find the container with id 5935b8bf464296de6d1a40f6aa1c4347a4d4d55ccaa7bd6f3356ed14ad5026f4
Oct 30 21:16:16.499858 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:16.499771    5937 generic.go:356] "Generic (PLEG): container finished" podID="af3c29d2-0c79-465d-a4a0-82c898c55c75" containerID="3cd8fc8dbd5edd2adb769848a3fb1a878f22f8784853d4b5780bbe0c9f7e5032" exitCode=0
Oct 30 21:16:16.500027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:16.499855    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771" event={"ID":"af3c29d2-0c79-465d-a4a0-82c898c55c75","Type":"ContainerDied","Data":"3cd8fc8dbd5edd2adb769848a3fb1a878f22f8784853d4b5780bbe0c9f7e5032"}
Oct 30 21:16:16.500027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:16.499896    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771" event={"ID":"af3c29d2-0c79-465d-a4a0-82c898c55c75","Type":"ContainerStarted","Data":"5935b8bf464296de6d1a40f6aa1c4347a4d4d55ccaa7bd6f3356ed14ad5026f4"}
Oct 30 21:16:17.644250 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:17.644223    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771"
Oct 30 21:16:17.976645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:17.976618    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3"]
Oct 30 21:16:17.976969 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:17.976958    5937 cpu_manager.go:414] "containerMap: removing container" podUID="af3c29d2-0c79-465d-a4a0-82c898c55c75" containerName="curl"
Oct 30 21:16:17.977020 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:17.976971    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af3c29d2-0c79-465d-a4a0-82c898c55c75" containerName="curl"
Oct 30 21:16:17.977068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:17.977059    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="af3c29d2-0c79-465d-a4a0-82c898c55c75" containerName="curl"
Oct 30 21:16:17.979968 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:17.979954    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3"
Oct 30 21:16:17.990704 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:17.990688    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3"
Oct 30 21:16:18.039353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:18.039323    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3"]
Oct 30 21:16:18.362428 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:18.362406    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3"]
Oct 30 21:16:18.365096 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:18.365068    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6822c66_2d44_425e_88a7_d89f9d7e910e.slice/crio-692426f31d91410ef6e819c91286219be64b386723e172ff36a5429baf9b1a0b WatchSource:0}: Error finding container 692426f31d91410ef6e819c91286219be64b386723e172ff36a5429baf9b1a0b: Status 404 returned error can't find the container with id 692426f31d91410ef6e819c91286219be64b386723e172ff36a5429baf9b1a0b
Oct 30 21:16:18.511000 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:18.510968    5937 generic.go:356] "Generic (PLEG): container finished" podID="c6822c66-2d44-425e-88a7-d89f9d7e910e" containerID="d179cffe3eac7a69f2749adc65679a85268393a9572a16a9b76170f518cf284d" exitCode=0
Oct 30 21:16:18.511137 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:18.511044    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3" event={"ID":"c6822c66-2d44-425e-88a7-d89f9d7e910e","Type":"ContainerDied","Data":"d179cffe3eac7a69f2749adc65679a85268393a9572a16a9b76170f518cf284d"}
Oct 30 21:16:18.511137 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:18.511089    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3" event={"ID":"c6822c66-2d44-425e-88a7-d89f9d7e910e","Type":"ContainerStarted","Data":"692426f31d91410ef6e819c91286219be64b386723e172ff36a5429baf9b1a0b"}
Oct 30 21:16:18.512383 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:18.512367    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771"
Oct 30 21:16:18.512494 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:18.512365    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771" event={"ID":"af3c29d2-0c79-465d-a4a0-82c898c55c75","Type":"ContainerDied","Data":"5935b8bf464296de6d1a40f6aa1c4347a4d4d55ccaa7bd6f3356ed14ad5026f4"}
Oct 30 21:16:18.512494 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:18.512484    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5935b8bf464296de6d1a40f6aa1c4347a4d4d55ccaa7bd6f3356ed14ad5026f4"
Oct 30 21:16:19.648022 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:19.647993    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3"
Oct 30 21:16:20.127801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.127765    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d"]
Oct 30 21:16:20.128195 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.128178    5937 cpu_manager.go:414] "containerMap: removing container" podUID="c6822c66-2d44-425e-88a7-d89f9d7e910e" containerName="curl"
Oct 30 21:16:20.128279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.128197    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6822c66-2d44-425e-88a7-d89f9d7e910e" containerName="curl"
Oct 30 21:16:20.128340 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.128323    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6822c66-2d44-425e-88a7-d89f9d7e910e" containerName="curl"
Oct 30 21:16:20.131183 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.131164    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d"
Oct 30 21:16:20.142165 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.142147    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d"
Oct 30 21:16:20.187632 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.187602    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d"]
Oct 30 21:16:20.513803 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.513779    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d"]
Oct 30 21:16:20.516253 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:20.516220    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcefe03b3_a924_4c00_808f_cd98e4df9f8e.slice/crio-1ac79c142e839b26c09e065c87591696c7f16e81694fa9a50ed86c5034541c8a WatchSource:0}: Error finding container 1ac79c142e839b26c09e065c87591696c7f16e81694fa9a50ed86c5034541c8a: Status 404 returned error can't find the container with id 1ac79c142e839b26c09e065c87591696c7f16e81694fa9a50ed86c5034541c8a
Oct 30 21:16:20.523047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.523023    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3"
Oct 30 21:16:20.523203 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.523055    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3" event={"ID":"c6822c66-2d44-425e-88a7-d89f9d7e910e","Type":"ContainerDied","Data":"692426f31d91410ef6e819c91286219be64b386723e172ff36a5429baf9b1a0b"}
Oct 30 21:16:20.523203 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.523091    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="692426f31d91410ef6e819c91286219be64b386723e172ff36a5429baf9b1a0b"
Oct 30 21:16:20.524593 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:20.524574    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d" event={"ID":"cefe03b3-a924-4c00-808f-cd98e4df9f8e","Type":"ContainerStarted","Data":"1ac79c142e839b26c09e065c87591696c7f16e81694fa9a50ed86c5034541c8a"}
Oct 30 21:16:21.530942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:21.530904    5937 generic.go:356] "Generic (PLEG): container finished" podID="cefe03b3-a924-4c00-808f-cd98e4df9f8e" containerID="eea2c1e1bbaedeb80105551f0f2d50fe3090b500752fc539cdac1944e00c4049" exitCode=0
Oct 30 21:16:21.531333 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:21.530996    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d" event={"ID":"cefe03b3-a924-4c00-808f-cd98e4df9f8e","Type":"ContainerDied","Data":"eea2c1e1bbaedeb80105551f0f2d50fe3090b500752fc539cdac1944e00c4049"}
Oct 30 21:16:22.667915 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:22.667891    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d"
Oct 30 21:16:23.541744 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:23.541718    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d"
Oct 30 21:16:23.541921 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:23.541743    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d" event={"ID":"cefe03b3-a924-4c00-808f-cd98e4df9f8e","Type":"ContainerDied","Data":"1ac79c142e839b26c09e065c87591696c7f16e81694fa9a50ed86c5034541c8a"}
Oct 30 21:16:23.541921 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:23.541776    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ac79c142e839b26c09e065c87591696c7f16e81694fa9a50ed86c5034541c8a"
Oct 30 21:16:24.293082 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:24.293050    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b"]
Oct 30 21:16:24.293463 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:24.293391    5937 cpu_manager.go:414] "containerMap: removing container" podUID="cefe03b3-a924-4c00-808f-cd98e4df9f8e" containerName="curl"
Oct 30 21:16:24.293463 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:24.293401    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cefe03b3-a924-4c00-808f-cd98e4df9f8e" containerName="curl"
Oct 30 21:16:24.293532 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:24.293482    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="cefe03b3-a924-4c00-808f-cd98e4df9f8e" containerName="curl"
Oct 30 21:16:24.296400 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:24.296385    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b"
Oct 30 21:16:24.352644 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:24.352611    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b"]
Oct 30 21:16:24.399920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:24.399900    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e36b1b0258a256\"/\"default-dockercfg-jpw68\""
Oct 30 21:16:24.407762 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:24.407742    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b"
Oct 30 21:16:24.778695 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:24.778669    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b"]
Oct 30 21:16:24.781184 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:24.781143    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f12bf25_3b96_4929_a8bf_8546010e4ab8.slice/crio-3b714fc3d51af9e37ce8979ee10f350524532b9794704cbb12028acfc50724ff WatchSource:0}: Error finding container 3b714fc3d51af9e37ce8979ee10f350524532b9794704cbb12028acfc50724ff: Status 404 returned error can't find the container with id 3b714fc3d51af9e37ce8979ee10f350524532b9794704cbb12028acfc50724ff
Oct 30 21:16:25.552913 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:25.552881    5937 generic.go:356] "Generic (PLEG): container finished" podID="8f12bf25-3b96-4929-a8bf-8546010e4ab8" containerID="d9c0967ee6d1baf30b44b3fee6ed6672ffa581ba5c0d87277a67310869f1c0bd" exitCode=0
Oct 30 21:16:25.553346 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:25.552959    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b" event={"ID":"8f12bf25-3b96-4929-a8bf-8546010e4ab8","Type":"ContainerDied","Data":"d9c0967ee6d1baf30b44b3fee6ed6672ffa581ba5c0d87277a67310869f1c0bd"}
Oct 30 21:16:25.553346 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:25.552986    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b" event={"ID":"8f12bf25-3b96-4929-a8bf-8546010e4ab8","Type":"ContainerStarted","Data":"3b714fc3d51af9e37ce8979ee10f350524532b9794704cbb12028acfc50724ff"}
Oct 30 21:16:26.692176 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:26.692150    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b"
Oct 30 21:16:27.563843 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:27.563814    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b"
Oct 30 21:16:27.564008 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:27.563849    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b" event={"ID":"8f12bf25-3b96-4929-a8bf-8546010e4ab8","Type":"ContainerDied","Data":"3b714fc3d51af9e37ce8979ee10f350524532b9794704cbb12028acfc50724ff"}
Oct 30 21:16:27.564008 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:27.563884    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b714fc3d51af9e37ce8979ee10f350524532b9794704cbb12028acfc50724ff"
Oct 30 21:16:28.459512 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:28.459474    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0"]
Oct 30 21:16:28.459914 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:28.459834    5937 cpu_manager.go:414] "containerMap: removing container" podUID="8f12bf25-3b96-4929-a8bf-8546010e4ab8" containerName="curl"
Oct 30 21:16:28.459914 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:28.459846    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f12bf25-3b96-4929-a8bf-8546010e4ab8" containerName="curl"
Oct 30 21:16:28.459991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:28.459936    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f12bf25-3b96-4929-a8bf-8546010e4ab8" containerName="curl"
Oct 30 21:16:28.463380 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:28.463366    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0"
Oct 30 21:16:28.519098 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:28.519070    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0"]
Oct 30 21:16:28.568220 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:28.568189    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e36b1b0258a256\"/\"default-dockercfg-jpw68\""
Oct 30 21:16:28.574303 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:28.574286    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0"
Oct 30 21:16:28.943680 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:28.943655    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0"]
Oct 30 21:16:28.946143 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:28.946116    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8e567bc_14ca_4815_bbf0_7df79d8c833a.slice/crio-be7fab835928d1a9c5b2a61e278cd5e4ab029f107e5196d6133f299ae766adfb WatchSource:0}: Error finding container be7fab835928d1a9c5b2a61e278cd5e4ab029f107e5196d6133f299ae766adfb: Status 404 returned error can't find the container with id be7fab835928d1a9c5b2a61e278cd5e4ab029f107e5196d6133f299ae766adfb
Oct 30 21:16:29.583040 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:29.583009    5937 generic.go:356] "Generic (PLEG): container finished" podID="c8e567bc-14ca-4815-bbf0-7df79d8c833a" containerID="2fd16eac81c5cc21a610af994c14bd464b7ceeb090b2ee846ca4eac7ef0b3117" exitCode=0
Oct 30 21:16:29.583448 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:29.583094    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0" event={"ID":"c8e567bc-14ca-4815-bbf0-7df79d8c833a","Type":"ContainerDied","Data":"2fd16eac81c5cc21a610af994c14bd464b7ceeb090b2ee846ca4eac7ef0b3117"}
Oct 30 21:16:29.583448 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:29.583132    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0" event={"ID":"c8e567bc-14ca-4815-bbf0-7df79d8c833a","Type":"ContainerStarted","Data":"be7fab835928d1a9c5b2a61e278cd5e4ab029f107e5196d6133f299ae766adfb"}
Oct 30 21:16:30.719929 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:30.719901    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0"
Oct 30 21:16:31.593506 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:31.593478    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0"
Oct 30 21:16:31.593686 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:31.593525    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0" event={"ID":"c8e567bc-14ca-4815-bbf0-7df79d8c833a","Type":"ContainerDied","Data":"be7fab835928d1a9c5b2a61e278cd5e4ab029f107e5196d6133f299ae766adfb"}
Oct 30 21:16:31.593686 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:31.593585    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be7fab835928d1a9c5b2a61e278cd5e4ab029f107e5196d6133f299ae766adfb"
Oct 30 21:16:32.643481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:32.643451    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b"]
Oct 30 21:16:32.643880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:32.643866    5937 cpu_manager.go:414] "containerMap: removing container" podUID="c8e567bc-14ca-4815-bbf0-7df79d8c833a" containerName="curl"
Oct 30 21:16:32.643924 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:32.643881    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8e567bc-14ca-4815-bbf0-7df79d8c833a" containerName="curl"
Oct 30 21:16:32.643956 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:32.643937    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8e567bc-14ca-4815-bbf0-7df79d8c833a" containerName="curl"
Oct 30 21:16:32.646838 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:32.646822    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b"
Oct 30 21:16:32.703335 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:32.703306    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b"]
Oct 30 21:16:32.752376 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:32.752352    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e36b1b0258a256\"/\"default-dockercfg-jpw68\""
Oct 30 21:16:32.758449 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:32.758431    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b"
Oct 30 21:16:33.131166 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:33.131140    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b"]
Oct 30 21:16:33.133928 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:33.133894    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda160130a_0146_4196_9b3a_3bcca1ddf109.slice/crio-c6ec1014cbdb6d69574df38795b382a390e6d22db8e490e63e6c53949fea67c4 WatchSource:0}: Error finding container c6ec1014cbdb6d69574df38795b382a390e6d22db8e490e63e6c53949fea67c4: Status 404 returned error can't find the container with id c6ec1014cbdb6d69574df38795b382a390e6d22db8e490e63e6c53949fea67c4
Oct 30 21:16:33.604790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:33.604756    5937 generic.go:356] "Generic (PLEG): container finished" podID="a160130a-0146-4196-9b3a-3bcca1ddf109" containerID="dc4d23ae63b6c9ac82f29dddc6ea9cf233495d092590f21eca8eae4947854aa3" exitCode=0
Oct 30 21:16:33.604953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:33.604803    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b" event={"ID":"a160130a-0146-4196-9b3a-3bcca1ddf109","Type":"ContainerDied","Data":"dc4d23ae63b6c9ac82f29dddc6ea9cf233495d092590f21eca8eae4947854aa3"}
Oct 30 21:16:33.604953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:33.604849    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b" event={"ID":"a160130a-0146-4196-9b3a-3bcca1ddf109","Type":"ContainerStarted","Data":"c6ec1014cbdb6d69574df38795b382a390e6d22db8e490e63e6c53949fea67c4"}
Oct 30 21:16:34.748794 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:34.748772    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b"
Oct 30 21:16:35.616557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:35.616506    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b" event={"ID":"a160130a-0146-4196-9b3a-3bcca1ddf109","Type":"ContainerDied","Data":"c6ec1014cbdb6d69574df38795b382a390e6d22db8e490e63e6c53949fea67c4"}
Oct 30 21:16:35.616557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:35.616554    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b"
Oct 30 21:16:35.616763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:35.616575    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6ec1014cbdb6d69574df38795b382a390e6d22db8e490e63e6c53949fea67c4"
Oct 30 21:16:36.820104 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:36.820071    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450"]
Oct 30 21:16:36.820488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:36.820445    5937 cpu_manager.go:414] "containerMap: removing container" podUID="a160130a-0146-4196-9b3a-3bcca1ddf109" containerName="curl"
Oct 30 21:16:36.820488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:36.820456    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a160130a-0146-4196-9b3a-3bcca1ddf109" containerName="curl"
Oct 30 21:16:36.820593 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:36.820560    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="a160130a-0146-4196-9b3a-3bcca1ddf109" containerName="curl"
Oct 30 21:16:36.823753 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:36.823727    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450"
Oct 30 21:16:36.877421 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:36.877395    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450"]
Oct 30 21:16:36.926404 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:36.926375    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e36b1b0258a256\"/\"default-dockercfg-jpw68\""
Oct 30 21:16:36.934957 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:36.934933    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450"
Oct 30 21:16:37.304501 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:37.304442    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450"]
Oct 30 21:16:37.306720 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:37.306681    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod701cfda8_571d_4821_b902_709636c3b0c1.slice/crio-e29842d95ae401cb4e515ea95018465119d76fa33d8309cc279d19df1801bd97 WatchSource:0}: Error finding container e29842d95ae401cb4e515ea95018465119d76fa33d8309cc279d19df1801bd97: Status 404 returned error can't find the container with id e29842d95ae401cb4e515ea95018465119d76fa33d8309cc279d19df1801bd97
Oct 30 21:16:37.628474 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:37.628396    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450" event={"ID":"701cfda8-571d-4821-b902-709636c3b0c1","Type":"ContainerStarted","Data":"b5b372edd3da69181fd9aef7519dbd2ca8a996c9bb16d0a963f1f16feadb707f"}
Oct 30 21:16:37.628474 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:37.628440    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450" event={"ID":"701cfda8-571d-4821-b902-709636c3b0c1","Type":"ContainerStarted","Data":"e29842d95ae401cb4e515ea95018465119d76fa33d8309cc279d19df1801bd97"}
Oct 30 21:16:37.744611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:37.744518    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450" podStartSLOduration=1.7444995589999999 podStartE2EDuration="1.744499559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:37.743981504 +0000 UTC m=+2372.699996284" watchObservedRunningTime="2026-10-30 21:16:37.744499559 +0000 UTC m=+2372.700514338"
Oct 30 21:16:45.669556 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:45.669513    5937 generic.go:356] "Generic (PLEG): container finished" podID="701cfda8-571d-4821-b902-709636c3b0c1" containerID="b5b372edd3da69181fd9aef7519dbd2ca8a996c9bb16d0a963f1f16feadb707f" exitCode=0
Oct 30 21:16:45.669986 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:45.669591    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450" event={"ID":"701cfda8-571d-4821-b902-709636c3b0c1","Type":"ContainerDied","Data":"b5b372edd3da69181fd9aef7519dbd2ca8a996c9bb16d0a963f1f16feadb707f"}
Oct 30 21:16:45.672128 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:16:45.672052    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:16:46.805695 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:46.805673    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450"
Oct 30 21:16:47.681023 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:47.680988    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450" event={"ID":"701cfda8-571d-4821-b902-709636c3b0c1","Type":"ContainerDied","Data":"e29842d95ae401cb4e515ea95018465119d76fa33d8309cc279d19df1801bd97"}
Oct 30 21:16:47.681023 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:47.681023    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450"
Oct 30 21:16:47.681345 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:47.681025    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e29842d95ae401cb4e515ea95018465119d76fa33d8309cc279d19df1801bd97"
Oct 30 21:16:49.057469 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.057437    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874"]
Oct 30 21:16:49.057871 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.057798    5937 cpu_manager.go:414] "containerMap: removing container" podUID="701cfda8-571d-4821-b902-709636c3b0c1" containerName="curl"
Oct 30 21:16:49.057871 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.057810    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="701cfda8-571d-4821-b902-709636c3b0c1" containerName="curl"
Oct 30 21:16:49.057942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.057892    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="701cfda8-571d-4821-b902-709636c3b0c1" containerName="curl"
Oct 30 21:16:49.061015 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.060998    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874"
Oct 30 21:16:49.116112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.116093    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-network-policy-18e36b1b0258a256\"/\"default-dockercfg-jpw68\""
Oct 30 21:16:49.122349 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.122329    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874"
Oct 30 21:16:49.167976 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.167947    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874"]
Oct 30 21:16:49.496204 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.496183    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874"]
Oct 30 21:16:49.498857 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:49.498832    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75f97b2a_5641_428c_88a1_72edeb52b5a9.slice/crio-83f67dca173496c0ab3c213acd5fe593614e0c52dce442af7e39c396b96de161 WatchSource:0}: Error finding container 83f67dca173496c0ab3c213acd5fe593614e0c52dce442af7e39c396b96de161: Status 404 returned error can't find the container with id 83f67dca173496c0ab3c213acd5fe593614e0c52dce442af7e39c396b96de161
Oct 30 21:16:49.692992 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.692959    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874" event={"ID":"75f97b2a-5641-428c-88a1-72edeb52b5a9","Type":"ContainerStarted","Data":"7ade76c93ed223ae3fc10a5f0221b01f78b25427570a9b33b8fa5c1cf87dcb20"}
Oct 30 21:16:49.693170 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.693000    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874" event={"ID":"75f97b2a-5641-428c-88a1-72edeb52b5a9","Type":"ContainerStarted","Data":"83f67dca173496c0ab3c213acd5fe593614e0c52dce442af7e39c396b96de161"}
Oct 30 21:16:49.810443 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:49.810331    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874" podStartSLOduration=0.81031837 podStartE2EDuration="810.31837ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:49.808840519 +0000 UTC m=+2384.764855296" watchObservedRunningTime="2026-10-30 21:16:49.81031837 +0000 UTC m=+2384.766333145"
Oct 30 21:16:57.736103 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:57.736068    5937 generic.go:356] "Generic (PLEG): container finished" podID="75f97b2a-5641-428c-88a1-72edeb52b5a9" containerID="7ade76c93ed223ae3fc10a5f0221b01f78b25427570a9b33b8fa5c1cf87dcb20" exitCode=0
Oct 30 21:16:57.736500 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:57.736137    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874" event={"ID":"75f97b2a-5641-428c-88a1-72edeb52b5a9","Type":"ContainerDied","Data":"7ade76c93ed223ae3fc10a5f0221b01f78b25427570a9b33b8fa5c1cf87dcb20"}
Oct 30 21:16:58.875044 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:58.875018    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874"
Oct 30 21:16:59.295237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.295209    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb"]
Oct 30 21:16:59.295598 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.295585    5937 cpu_manager.go:414] "containerMap: removing container" podUID="75f97b2a-5641-428c-88a1-72edeb52b5a9" containerName="curl"
Oct 30 21:16:59.295654 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.295599    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75f97b2a-5641-428c-88a1-72edeb52b5a9" containerName="curl"
Oct 30 21:16:59.295690 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.295674    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="75f97b2a-5641-428c-88a1-72edeb52b5a9" containerName="curl"
Oct 30 21:16:59.298515 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.298500    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb"
Oct 30 21:16:59.309163 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.309146    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb"
Oct 30 21:16:59.353889 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.353855    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb"]
Oct 30 21:16:59.681930 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.681909    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb"]
Oct 30 21:16:59.684807 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:16:59.684770    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99117b0f_8d6e_48b8_ac84_9dfbc30597b3.slice/crio-fce65c4533a8578b1654259cfd3ff1fe016c54294f2e247b3ce5796738d2a187 WatchSource:0}: Error finding container fce65c4533a8578b1654259cfd3ff1fe016c54294f2e247b3ce5796738d2a187: Status 404 returned error can't find the container with id fce65c4533a8578b1654259cfd3ff1fe016c54294f2e247b3ce5796738d2a187
Oct 30 21:16:59.748309 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.748271    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb" event={"ID":"99117b0f-8d6e-48b8-ac84-9dfbc30597b3","Type":"ContainerStarted","Data":"76f9500949ccb424c9a38f56702de32e1452cd4bc9d622f95f5df168d24986df"}
Oct 30 21:16:59.748437 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.748323    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb" event={"ID":"99117b0f-8d6e-48b8-ac84-9dfbc30597b3","Type":"ContainerStarted","Data":"fce65c4533a8578b1654259cfd3ff1fe016c54294f2e247b3ce5796738d2a187"}
Oct 30 21:16:59.749627 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.749608    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874"
Oct 30 21:16:59.749757 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.749637    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874" event={"ID":"75f97b2a-5641-428c-88a1-72edeb52b5a9","Type":"ContainerDied","Data":"83f67dca173496c0ab3c213acd5fe593614e0c52dce442af7e39c396b96de161"}
Oct 30 21:16:59.749757 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:16:59.749668    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83f67dca173496c0ab3c213acd5fe593614e0c52dce442af7e39c396b96de161"
Oct 30 21:17:07.793592 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:07.793559    5937 generic.go:356] "Generic (PLEG): container finished" podID="99117b0f-8d6e-48b8-ac84-9dfbc30597b3" containerID="76f9500949ccb424c9a38f56702de32e1452cd4bc9d622f95f5df168d24986df" exitCode=0
Oct 30 21:17:07.794006 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:07.793566    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb" event={"ID":"99117b0f-8d6e-48b8-ac84-9dfbc30597b3","Type":"ContainerDied","Data":"76f9500949ccb424c9a38f56702de32e1452cd4bc9d622f95f5df168d24986df"}
Oct 30 21:17:08.934864 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:08.934838    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb"
Oct 30 21:17:09.531235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.531201    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064"]
Oct 30 21:17:09.531635 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.531620    5937 cpu_manager.go:414] "containerMap: removing container" podUID="99117b0f-8d6e-48b8-ac84-9dfbc30597b3" containerName="curl"
Oct 30 21:17:09.531635 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.531635    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99117b0f-8d6e-48b8-ac84-9dfbc30597b3" containerName="curl"
Oct 30 21:17:09.531730 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.531693    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="99117b0f-8d6e-48b8-ac84-9dfbc30597b3" containerName="curl"
Oct 30 21:17:09.534712 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.534698    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064"
Oct 30 21:17:09.545059 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.545038    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064"
Oct 30 21:17:09.594327 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.594297    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064"]
Oct 30 21:17:09.806763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.806731    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb" event={"ID":"99117b0f-8d6e-48b8-ac84-9dfbc30597b3","Type":"ContainerDied","Data":"fce65c4533a8578b1654259cfd3ff1fe016c54294f2e247b3ce5796738d2a187"}
Oct 30 21:17:09.806917 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.806779    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fce65c4533a8578b1654259cfd3ff1fe016c54294f2e247b3ce5796738d2a187"
Oct 30 21:17:09.806917 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:09.806744    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb"
Oct 30 21:17:10.130166 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:10.129871    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064"]
Oct 30 21:17:10.132564 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:17:10.132520    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod648f95d9_6b70_430c_8939_8e71565d216e.slice/crio-38aea9823856881ebf308b76f2f2a65b06c19ff7121b8dbc0b01837b86ffbf06 WatchSource:0}: Error finding container 38aea9823856881ebf308b76f2f2a65b06c19ff7121b8dbc0b01837b86ffbf06: Status 404 returned error can't find the container with id 38aea9823856881ebf308b76f2f2a65b06c19ff7121b8dbc0b01837b86ffbf06
Oct 30 21:17:10.812984 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:10.812946    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064" event={"ID":"648f95d9-6b70-430c-8939-8e71565d216e","Type":"ContainerStarted","Data":"440bdc5335533a758c72f2a22668e08477f1d5bafb02704ecda303a48acbf579"}
Oct 30 21:17:10.813160 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:10.812995    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064" event={"ID":"648f95d9-6b70-430c-8939-8e71565d216e","Type":"ContainerStarted","Data":"38aea9823856881ebf308b76f2f2a65b06c19ff7121b8dbc0b01837b86ffbf06"}
Oct 30 21:17:10.935205 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:10.935156    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064" podStartSLOduration=1.9351395519999999 podStartE2EDuration="1.935139552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:10.934270018 +0000 UTC m=+2405.890284794" watchObservedRunningTime="2026-10-30 21:17:10.935139552 +0000 UTC m=+2405.891154329"
Oct 30 21:17:15.672083 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:17:15.672044    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:17:17.851229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:17.851197    5937 generic.go:356] "Generic (PLEG): container finished" podID="648f95d9-6b70-430c-8939-8e71565d216e" containerID="440bdc5335533a758c72f2a22668e08477f1d5bafb02704ecda303a48acbf579" exitCode=0
Oct 30 21:17:17.851634 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:17.851257    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064" event={"ID":"648f95d9-6b70-430c-8939-8e71565d216e","Type":"ContainerDied","Data":"440bdc5335533a758c72f2a22668e08477f1d5bafb02704ecda303a48acbf579"}
Oct 30 21:17:18.992017 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:18.991994    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064"
Oct 30 21:17:19.782958 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.782924    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb"]
Oct 30 21:17:19.783316 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.783304    5937 cpu_manager.go:414] "containerMap: removing container" podUID="648f95d9-6b70-430c-8939-8e71565d216e" containerName="curl"
Oct 30 21:17:19.783359 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.783317    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="648f95d9-6b70-430c-8939-8e71565d216e" containerName="curl"
Oct 30 21:17:19.783394 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.783376    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="648f95d9-6b70-430c-8939-8e71565d216e" containerName="curl"
Oct 30 21:17:19.786457 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.786442    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb"
Oct 30 21:17:19.797433 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.797414    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb"
Oct 30 21:17:19.851553 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.851508    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb"]
Oct 30 21:17:19.864300 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.864276    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064"
Oct 30 21:17:19.864300 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.864288    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064" event={"ID":"648f95d9-6b70-430c-8939-8e71565d216e","Type":"ContainerDied","Data":"38aea9823856881ebf308b76f2f2a65b06c19ff7121b8dbc0b01837b86ffbf06"}
Oct 30 21:17:19.864489 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:19.864320    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38aea9823856881ebf308b76f2f2a65b06c19ff7121b8dbc0b01837b86ffbf06"
Oct 30 21:17:20.366325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:20.366251    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb"]
Oct 30 21:17:20.368688 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:17:20.368661    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode974e11f_0571_44f7_9bcb_2ba3b82006c7.slice/crio-a3d3d1150c917423ac9297d1ca6c6b2afdf3d7c1deb36c418c1047bb84236f69 WatchSource:0}: Error finding container a3d3d1150c917423ac9297d1ca6c6b2afdf3d7c1deb36c418c1047bb84236f69: Status 404 returned error can't find the container with id a3d3d1150c917423ac9297d1ca6c6b2afdf3d7c1deb36c418c1047bb84236f69
Oct 30 21:17:20.870929 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:20.870893    5937 generic.go:356] "Generic (PLEG): container finished" podID="e974e11f-0571-44f7-9bcb-2ba3b82006c7" containerID="b3d2c0689d522220822766ecddd1f59bf63731c6d8fc383153f77fc1ec3254c8" exitCode=0
Oct 30 21:17:20.871116 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:20.870992    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb" event={"ID":"e974e11f-0571-44f7-9bcb-2ba3b82006c7","Type":"ContainerDied","Data":"b3d2c0689d522220822766ecddd1f59bf63731c6d8fc383153f77fc1ec3254c8"}
Oct 30 21:17:20.871116 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:20.871037    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb" event={"ID":"e974e11f-0571-44f7-9bcb-2ba3b82006c7","Type":"ContainerStarted","Data":"a3d3d1150c917423ac9297d1ca6c6b2afdf3d7c1deb36c418c1047bb84236f69"}
Oct 30 21:17:22.002032 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:22.002012    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb"
Oct 30 21:17:22.881368 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:22.881341    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb"
Oct 30 21:17:22.881557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:22.881381    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb" event={"ID":"e974e11f-0571-44f7-9bcb-2ba3b82006c7","Type":"ContainerDied","Data":"a3d3d1150c917423ac9297d1ca6c6b2afdf3d7c1deb36c418c1047bb84236f69"}
Oct 30 21:17:22.881557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:22.881419    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3d3d1150c917423ac9297d1ca6c6b2afdf3d7c1deb36c418c1047bb84236f69"
Oct 30 21:17:23.965909 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:23.965873    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452"]
Oct 30 21:17:23.966437 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:23.966420    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e974e11f-0571-44f7-9bcb-2ba3b82006c7" containerName="curl"
Oct 30 21:17:23.966481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:23.966439    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e974e11f-0571-44f7-9bcb-2ba3b82006c7" containerName="curl"
Oct 30 21:17:23.966515 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:23.966507    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e974e11f-0571-44f7-9bcb-2ba3b82006c7" containerName="curl"
Oct 30 21:17:23.969888 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:23.969869    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452"
Oct 30 21:17:23.980351 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:23.980332    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452"
Oct 30 21:17:24.029486 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:24.029456    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452"]
Oct 30 21:17:24.560262 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:24.560235    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452"]
Oct 30 21:17:24.562672 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:17:24.562646    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1bbb7d9_f825_46af_a3db_0dd7ec2ca856.slice/crio-a8c3019905b9ace04aed2984c9d5ac5e1a5becf0eddce2856ef22e2e308c48e2 WatchSource:0}: Error finding container a8c3019905b9ace04aed2984c9d5ac5e1a5becf0eddce2856ef22e2e308c48e2: Status 404 returned error can't find the container with id a8c3019905b9ace04aed2984c9d5ac5e1a5becf0eddce2856ef22e2e308c48e2
Oct 30 21:17:24.893782 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:24.893687    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452" event={"ID":"a1bbb7d9-f825-46af-a3db-0dd7ec2ca856","Type":"ContainerStarted","Data":"fc784d3b3f322a3407b86a4bbbaf57dc1d3c615a1cc2848b080d6532bc92471d"}
Oct 30 21:17:24.893782 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:24.893732    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452" event={"ID":"a1bbb7d9-f825-46af-a3db-0dd7ec2ca856","Type":"ContainerStarted","Data":"a8c3019905b9ace04aed2984c9d5ac5e1a5becf0eddce2856ef22e2e308c48e2"}
Oct 30 21:17:25.011073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:25.011020    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452" podStartSLOduration=2.011005459 podStartE2EDuration="2.011005459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:25.008793398 +0000 UTC m=+2419.964808174" watchObservedRunningTime="2026-10-30 21:17:25.011005459 +0000 UTC m=+2419.967020236"
Oct 30 21:17:29.919207 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:29.919123    5937 generic.go:356] "Generic (PLEG): container finished" podID="a1bbb7d9-f825-46af-a3db-0dd7ec2ca856" containerID="fc784d3b3f322a3407b86a4bbbaf57dc1d3c615a1cc2848b080d6532bc92471d" exitCode=0
Oct 30 21:17:29.919207 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:29.919193    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452" event={"ID":"a1bbb7d9-f825-46af-a3db-0dd7ec2ca856","Type":"ContainerDied","Data":"fc784d3b3f322a3407b86a4bbbaf57dc1d3c615a1cc2848b080d6532bc92471d"}
Oct 30 21:17:31.059119 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:31.059095    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452"
Oct 30 21:17:31.934470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:31.934431    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452" event={"ID":"a1bbb7d9-f825-46af-a3db-0dd7ec2ca856","Type":"ContainerDied","Data":"a8c3019905b9ace04aed2984c9d5ac5e1a5becf0eddce2856ef22e2e308c48e2"}
Oct 30 21:17:31.934766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:31.934746    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8c3019905b9ace04aed2984c9d5ac5e1a5becf0eddce2856ef22e2e308c48e2"
Oct 30 21:17:31.934958 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:31.934945    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452"
Oct 30 21:17:32.176879 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.176844    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"]
Oct 30 21:17:32.177263 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.177221    5937 cpu_manager.go:414] "containerMap: removing container" podUID="a1bbb7d9-f825-46af-a3db-0dd7ec2ca856" containerName="curl"
Oct 30 21:17:32.177263 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.177230    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1bbb7d9-f825-46af-a3db-0dd7ec2ca856" containerName="curl"
Oct 30 21:17:32.177356 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.177297    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1bbb7d9-f825-46af-a3db-0dd7ec2ca856" containerName="curl"
Oct 30 21:17:32.180412 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.180384    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"
Oct 30 21:17:32.236569 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.236521    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:17:32.237413 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.237382    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"]
Oct 30 21:17:32.311476 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.311445    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/c7c99e44-5575-4333-b021-d5211cc850e8-client-certificate\") pod \"targetallocator-mtls-allowed-18e36b4c4a50a123\" (UID: \"c7c99e44-5575-4333-b021-d5211cc850e8\") " pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"
Oct 30 21:17:32.412347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.412305    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/c7c99e44-5575-4333-b021-d5211cc850e8-client-certificate\") pod \"targetallocator-mtls-allowed-18e36b4c4a50a123\" (UID: \"c7c99e44-5575-4333-b021-d5211cc850e8\") " pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"
Oct 30 21:17:32.414945 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.414921    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/c7c99e44-5575-4333-b021-d5211cc850e8-client-certificate\") pod \"targetallocator-mtls-allowed-18e36b4c4a50a123\" (UID: \"c7c99e44-5575-4333-b021-d5211cc850e8\") " pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"
Oct 30 21:17:32.492956 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.492929    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"
Oct 30 21:17:32.862724 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.862702    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"]
Oct 30 21:17:32.864739 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:17:32.864714    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7c99e44_5575_4333_b021_d5211cc850e8.slice/crio-a8b97ae0c410e6c2c0b879e8109133987c471cb234f04fea0a04e88ecbbbcdad WatchSource:0}: Error finding container a8b97ae0c410e6c2c0b879e8109133987c471cb234f04fea0a04e88ecbbbcdad: Status 404 returned error can't find the container with id a8b97ae0c410e6c2c0b879e8109133987c471cb234f04fea0a04e88ecbbbcdad
Oct 30 21:17:32.942799 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.942769    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123" event={"ID":"c7c99e44-5575-4333-b021-d5211cc850e8","Type":"ContainerStarted","Data":"1d39267b9cf6e34528209eebba6a0a6edeef8a508ea392a01b09566370febf00"}
Oct 30 21:17:32.942941 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:32.942811    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123" event={"ID":"c7c99e44-5575-4333-b021-d5211cc850e8","Type":"ContainerStarted","Data":"a8b97ae0c410e6c2c0b879e8109133987c471cb234f04fea0a04e88ecbbbcdad"}
Oct 30 21:17:33.060274 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:33.060222    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123" podStartSLOduration=1.060205478 podStartE2EDuration="1.060205478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:33.059464997 +0000 UTC m=+2428.015479777" watchObservedRunningTime="2026-10-30 21:17:33.060205478 +0000 UTC m=+2428.016220254"
Oct 30 21:17:33.949995 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:33.949956    5937 generic.go:356] "Generic (PLEG): container finished" podID="c7c99e44-5575-4333-b021-d5211cc850e8" containerID="1d39267b9cf6e34528209eebba6a0a6edeef8a508ea392a01b09566370febf00" exitCode=0
Oct 30 21:17:33.950365 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:33.950046    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123" event={"ID":"c7c99e44-5575-4333-b021-d5211cc850e8","Type":"ContainerDied","Data":"1d39267b9cf6e34528209eebba6a0a6edeef8a508ea392a01b09566370febf00"}
Oct 30 21:17:35.087161 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:35.087135    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"
Oct 30 21:17:35.241644 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:35.241563    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c7c99e44-5575-4333-b021-d5211cc850e8-client-certificate\" (UniqueName: \"kubernetes.io/secret/c7c99e44-5575-4333-b021-d5211cc850e8-client-certificate\") pod \"c7c99e44-5575-4333-b021-d5211cc850e8\" (UID: \"c7c99e44-5575-4333-b021-d5211cc850e8\") "
Oct 30 21:17:35.243770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:35.243737    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7c99e44-5575-4333-b021-d5211cc850e8-client-certificate" pod "c7c99e44-5575-4333-b021-d5211cc850e8" (UID: "c7c99e44-5575-4333-b021-d5211cc850e8"). InnerVolumeSpecName "client-certificate". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:35.343096 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:35.343064    5937 reconciler_common.go:299] "Volume detached for volume \"client-certificate\" (UniqueName: \"kubernetes.io/secret/c7c99e44-5575-4333-b021-d5211cc850e8-client-certificate\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:35.961272 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:35.961243    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"
Oct 30 21:17:35.961272 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:35.961261    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123" event={"ID":"c7c99e44-5575-4333-b021-d5211cc850e8","Type":"ContainerDied","Data":"a8b97ae0c410e6c2c0b879e8109133987c471cb234f04fea0a04e88ecbbbcdad"}
Oct 30 21:17:35.961489 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:35.961301    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8b97ae0c410e6c2c0b879e8109133987c471cb234f04fea0a04e88ecbbbcdad"
Oct 30 21:17:36.343666 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.343588    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f"]
Oct 30 21:17:36.344030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.343973    5937 cpu_manager.go:414] "containerMap: removing container" podUID="c7c99e44-5575-4333-b021-d5211cc850e8" containerName="curl"
Oct 30 21:17:36.344030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.343985    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7c99e44-5575-4333-b021-d5211cc850e8" containerName="curl"
Oct 30 21:17:36.344098 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.344082    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7c99e44-5575-4333-b021-d5211cc850e8" containerName="curl"
Oct 30 21:17:36.347056 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.347038    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f"
Oct 30 21:17:36.357770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.357752    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f"
Oct 30 21:17:36.403374 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.403344    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f"]
Oct 30 21:17:36.731283 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.731260    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f"]
Oct 30 21:17:36.734312 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:17:36.734286    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a3dbf44_442f_4bf7_ab7f_7fde1e6a9126.slice/crio-82927d044f6c2985c6bb87a47b63fb63950620f9bfe58b531ff3f8a0dd13096a WatchSource:0}: Error finding container 82927d044f6c2985c6bb87a47b63fb63950620f9bfe58b531ff3f8a0dd13096a: Status 404 returned error can't find the container with id 82927d044f6c2985c6bb87a47b63fb63950620f9bfe58b531ff3f8a0dd13096a
Oct 30 21:17:36.968814 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.968776    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f" event={"ID":"5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126","Type":"ContainerStarted","Data":"3960808d6078497a46448ed154d02350df741f5361a25b3882cd762160c557d5"}
Oct 30 21:17:36.968814 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:36.968819    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f" event={"ID":"5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126","Type":"ContainerStarted","Data":"82927d044f6c2985c6bb87a47b63fb63950620f9bfe58b531ff3f8a0dd13096a"}
Oct 30 21:17:37.085563 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:37.085444    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f" podStartSLOduration=1.085430246 podStartE2EDuration="1.085430246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:37.084584852 +0000 UTC m=+2432.040599629" watchObservedRunningTime="2026-10-30 21:17:37.085430246 +0000 UTC m=+2432.041445021"
Oct 30 21:17:41.996249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:41.996214    5937 generic.go:356] "Generic (PLEG): container finished" podID="5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126" containerID="3960808d6078497a46448ed154d02350df741f5361a25b3882cd762160c557d5" exitCode=0
Oct 30 21:17:41.996669 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:41.996283    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f" event={"ID":"5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126","Type":"ContainerDied","Data":"3960808d6078497a46448ed154d02350df741f5361a25b3882cd762160c557d5"}
Oct 30 21:17:43.132970 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:43.132940    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f"
Oct 30 21:17:44.008429 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.008401    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f"
Oct 30 21:17:44.008629 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.008399    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f" event={"ID":"5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126","Type":"ContainerDied","Data":"82927d044f6c2985c6bb87a47b63fb63950620f9bfe58b531ff3f8a0dd13096a"}
Oct 30 21:17:44.008629 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.008517    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82927d044f6c2985c6bb87a47b63fb63950620f9bfe58b531ff3f8a0dd13096a"
Oct 30 21:17:44.448939 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.448830    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f"]
Oct 30 21:17:44.462313 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.462279    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-untrusted-denied-18e36b4d42dee98f"]
Oct 30 21:17:44.499472 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.499438    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"]
Oct 30 21:17:44.512923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.512894    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-mtls-allowed-18e36b4c4a50a123"]
Oct 30 21:17:44.532235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.532195    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452"]
Oct 30 21:17:44.539078 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.539050    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-untrusted-denied-18e36b4a5ff97452"]
Oct 30 21:17:44.554516 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.554486    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb"]
Oct 30 21:17:44.556128 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.556103    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/targetallocator-collector-allowed-18e36b4966a43dbb"]
Oct 30 21:17:44.579654 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.579622    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064"]
Oct 30 21:17:44.583662 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.583634    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-wrong-role-denied-18e36b4703f1b064"]
Oct 30 21:17:44.610588 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.610560    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb"]
Oct 30 21:17:44.617545 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.617515    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-role-only-denied-18e36b44a1d60fcb"]
Oct 30 21:17:44.641007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.640977    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874"]
Oct 30 21:17:44.646936 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.646913    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-part-only-denied-18e36b42406de874"]
Oct 30 21:17:44.667633 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.667600    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450"]
Oct 30 21:17:44.670781 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.670754    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-unlabeled-denied-18e36b3f66431450"]
Oct 30 21:17:44.691961 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.691941    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b"]
Oct 30 21:17:44.695091 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.695073    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-inferenceservice-allowed-18e36b3e6d04813b"]
Oct 30 21:17:44.728781 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.728758    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0"]
Oct 30 21:17:44.737681 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.737656    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-scheduler-allowed-18e36b3d74bfcea0"]
Oct 30 21:17:44.760613 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.760589    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b"]
Oct 30 21:17:44.763296 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.763277    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-prefill-allowed-18e36b3c7c6dbc5b"]
Oct 30 21:17:44.788860 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.788829    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d"]
Oct 30 21:17:44.793321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.793293    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-prefill-allowed-18e36b3b8413529d"]
Oct 30 21:17:44.820338 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.820298    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3"]
Oct 30 21:17:44.825961 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.825932    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-leader-allowed-18e36b3b016587d3"]
Oct 30 21:17:44.847651 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.847621    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771"]
Oct 30 21:17:44.852350 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.852319    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-worker-allowed-18e36b3a808c5771"]
Oct 30 21:17:44.874899 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.874867    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52"]
Oct 30 21:17:44.879954 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.879932    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-prefill-allowed-18e36b39874acd52"]
Oct 30 21:17:44.900061 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.900035    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e"]
Oct 30 21:17:44.904842 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.904824    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-network-policy-18e36b1b0258a256/collector-otlp-workload-allowed-18e36b388e0cd30e"]
Oct 30 21:17:44.927965 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.927937    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3"]
Oct 30 21:17:44.929077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.929057    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-wrong-role-denied-18e36b362c053ad3"]
Oct 30 21:17:44.952177 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.952145    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55"]
Oct 30 21:17:44.956421 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.956394    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-role-only-denied-18e36b33cacf1c55"]
Oct 30 21:17:44.979340 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.979270    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94"]
Oct 30 21:17:44.987597 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:44.987576    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-part-only-denied-18e36b3168f67e94"]
Oct 30 21:17:45.009942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.009913    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b"]
Oct 30 21:17:45.015361 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.015340    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-unlabeled-denied-18e36b2f0717441b"]
Oct 30 21:17:45.039035 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.039005    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a"]
Oct 30 21:17:45.045229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.045208    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-inferenceservice-allowed-18e36b2c2c82c07a"]
Oct 30 21:17:45.066559 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.066512    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493"]
Oct 30 21:17:45.070709 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.070687    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-scheduler-allowed-18e36b29cac7e493"]
Oct 30 21:17:45.091800 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.091780    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24"]
Oct 30 21:17:45.096527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.096502    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-prefill-allowed-18e36b2768fc6a24"]
Oct 30 21:17:45.117250 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.117223    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509"]
Oct 30 21:17:45.124855 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.124828    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-prefill-allowed-18e36b2506ef8509"]
Oct 30 21:17:45.146686 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.146660    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf"]
Oct 30 21:17:45.151462 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.151438    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-leader-allowed-18e36b22a534b7cf"]
Oct 30 21:17:45.161128 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.161105    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27f29007-9c6c-459a-8c88-fa4fe0d00363" path="/var/lib/kubelet/pods/27f29007-9c6c-459a-8c88-fa4fe0d00363/volumes"
Oct 30 21:17:45.161400 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.161383    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="412be3c9-8e26-494c-b6fa-cb15535947f7" path="/var/lib/kubelet/pods/412be3c9-8e26-494c-b6fa-cb15535947f7/volumes"
Oct 30 21:17:45.161650 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.161636    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126" path="/var/lib/kubelet/pods/5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126/volumes"
Oct 30 21:17:45.161872 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.161861    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="648f95d9-6b70-430c-8939-8e71565d216e" path="/var/lib/kubelet/pods/648f95d9-6b70-430c-8939-8e71565d216e/volumes"
Oct 30 21:17:45.162090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.162078    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6bf5bcad-8005-4499-a0d9-c51805cf57eb" path="/var/lib/kubelet/pods/6bf5bcad-8005-4499-a0d9-c51805cf57eb/volumes"
Oct 30 21:17:45.162643 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.162630    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="701cfda8-571d-4821-b902-709636c3b0c1" path="/var/lib/kubelet/pods/701cfda8-571d-4821-b902-709636c3b0c1/volumes"
Oct 30 21:17:45.162855 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.162843    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75f97b2a-5641-428c-88a1-72edeb52b5a9" path="/var/lib/kubelet/pods/75f97b2a-5641-428c-88a1-72edeb52b5a9/volumes"
Oct 30 21:17:45.163072 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.163060    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="78741f44-0507-48dd-af24-3310a587959a" path="/var/lib/kubelet/pods/78741f44-0507-48dd-af24-3310a587959a/volumes"
Oct 30 21:17:45.163277 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.163265    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f12bf25-3b96-4929-a8bf-8546010e4ab8" path="/var/lib/kubelet/pods/8f12bf25-3b96-4929-a8bf-8546010e4ab8/volumes"
Oct 30 21:17:45.163498 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.163479    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="99117b0f-8d6e-48b8-ac84-9dfbc30597b3" path="/var/lib/kubelet/pods/99117b0f-8d6e-48b8-ac84-9dfbc30597b3/volumes"
Oct 30 21:17:45.164047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.164032    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a160130a-0146-4196-9b3a-3bcca1ddf109" path="/var/lib/kubelet/pods/a160130a-0146-4196-9b3a-3bcca1ddf109/volumes"
Oct 30 21:17:45.164267 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.164255    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1bbb7d9-f825-46af-a3db-0dd7ec2ca856" path="/var/lib/kubelet/pods/a1bbb7d9-f825-46af-a3db-0dd7ec2ca856/volumes"
Oct 30 21:17:45.164464 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.164454    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac870c9a-fee6-48c4-8b5f-f3367b0a832c" path="/var/lib/kubelet/pods/ac870c9a-fee6-48c4-8b5f-f3367b0a832c/volumes"
Oct 30 21:17:45.164669 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.164658    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af3c29d2-0c79-465d-a4a0-82c898c55c75" path="/var/lib/kubelet/pods/af3c29d2-0c79-465d-a4a0-82c898c55c75/volumes"
Oct 30 21:17:45.164864 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.164853    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5" path="/var/lib/kubelet/pods/b3fc4a1a-fdce-4e22-b847-bb6f06fe46a5/volumes"
Oct 30 21:17:45.165312 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.165298    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6822c66-2d44-425e-88a7-d89f9d7e910e" path="/var/lib/kubelet/pods/c6822c66-2d44-425e-88a7-d89f9d7e910e/volumes"
Oct 30 21:17:45.165614 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.165600    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7c99e44-5575-4333-b021-d5211cc850e8" path="/var/lib/kubelet/pods/c7c99e44-5575-4333-b021-d5211cc850e8/volumes"
Oct 30 21:17:45.165844 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.165832    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8e567bc-14ca-4815-bbf0-7df79d8c833a" path="/var/lib/kubelet/pods/c8e567bc-14ca-4815-bbf0-7df79d8c833a/volumes"
Oct 30 21:17:45.166023 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.166013    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cefe03b3-a924-4c00-808f-cd98e4df9f8e" path="/var/lib/kubelet/pods/cefe03b3-a924-4c00-808f-cd98e4df9f8e/volumes"
Oct 30 21:17:45.166475 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.166463    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="debc4eb2-aebc-4724-aebb-42ce22a17a57" path="/var/lib/kubelet/pods/debc4eb2-aebc-4724-aebb-42ce22a17a57/volumes"
Oct 30 21:17:45.166689 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.166677    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0a6a195-489a-44b2-bd6f-366f465cb5f0" path="/var/lib/kubelet/pods/e0a6a195-489a-44b2-bd6f-366f465cb5f0/volumes"
Oct 30 21:17:45.166871 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.166858    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e78c1e56-04dd-410e-9a61-80b0fe4ca9d9" path="/var/lib/kubelet/pods/e78c1e56-04dd-410e-9a61-80b0fe4ca9d9/volumes"
Oct 30 21:17:45.167060 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.167049    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e974e11f-0571-44f7-9bcb-2ba3b82006c7" path="/var/lib/kubelet/pods/e974e11f-0571-44f7-9bcb-2ba3b82006c7/volumes"
Oct 30 21:17:45.167248 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.167237    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f74da29c-16db-40e5-8e3d-2e354a98adca" path="/var/lib/kubelet/pods/f74da29c-16db-40e5-8e3d-2e354a98adca/volumes"
Oct 30 21:17:45.167723 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.167710    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f87abb32-b240-4e24-979b-e8d2c5c25ca5" path="/var/lib/kubelet/pods/f87abb32-b240-4e24-979b-e8d2c5c25ca5/volumes"
Oct 30 21:17:45.174144 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.174126    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623"]
Oct 30 21:17:45.176543 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.176516    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-worker-allowed-18e36b1fcb3a8623"]
Oct 30 21:17:45.197179 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.197153    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761"]
Oct 30 21:17:45.202315 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.202295    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-prefill-allowed-18e36b1d6937c761"]
Oct 30 21:17:45.223264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.223237    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90"]
Oct 30 21:17:45.228126 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.228105    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-otlp-workload-allowed-18e36b1b04717e90"]
Oct 30 21:17:45.275019 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.274936    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86"]
Oct 30 21:17:45.279368 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:45.279343    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/collector-untrusted-denied-18e36b182770ec86"]
Oct 30 21:17:45.672551 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:17:45.672446    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:17:46.564393 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:46.564365    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9"]
Oct 30 21:17:46.564739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:46.564726    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126" containerName="curl"
Oct 30 21:17:46.564793 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:46.564740    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126" containerName="curl"
Oct 30 21:17:46.564836 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:46.564827    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a3dbf44-442f-4bf7-ab7f-7fde1e6a9126" containerName="curl"
Oct 30 21:17:46.569663 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:46.569642    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9"
Oct 30 21:17:46.628115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:46.628086    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"collector-namespace-auth-18e36b4f60efd942\"/\"default-dockercfg-8djrv\""
Oct 30 21:17:46.631411 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:46.631381    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9"
Oct 30 21:17:46.679030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:46.679000    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9"]
Oct 30 21:17:47.006618 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:47.006423    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9"]
Oct 30 21:17:47.009377 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:17:47.009350    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeff7bc20_9396_4fd6_88ed_179f61d3c5e6.slice/crio-3e7d42a559d532e5ec713a4c990a634d3a72f9aff874d9b17a18c79c729b91ea WatchSource:0}: Error finding container 3e7d42a559d532e5ec713a4c990a634d3a72f9aff874d9b17a18c79c729b91ea: Status 404 returned error can't find the container with id 3e7d42a559d532e5ec713a4c990a634d3a72f9aff874d9b17a18c79c729b91ea
Oct 30 21:17:47.025613 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:47.025580    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9" event={"ID":"eff7bc20-9396-4fd6-88ed-179f61d3c5e6","Type":"ContainerStarted","Data":"3e7d42a559d532e5ec713a4c990a634d3a72f9aff874d9b17a18c79c729b91ea"}
Oct 30 21:17:47.162213 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:47.162178    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7915b1e-faa2-494e-9d9b-82c497514b4b" path="/var/lib/kubelet/pods/b7915b1e-faa2-494e-9d9b-82c497514b4b/volumes"
Oct 30 21:17:47.162428 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:47.162415    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d90af14c-80ca-4045-8169-94e27843da74" path="/var/lib/kubelet/pods/d90af14c-80ca-4045-8169-94e27843da74/volumes"
Oct 30 21:17:47.162639 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:47.162627    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="de698771-d2f2-44d1-9d82-4f891c3a349f" path="/var/lib/kubelet/pods/de698771-d2f2-44d1-9d82-4f891c3a349f/volumes"
Oct 30 21:17:47.162830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:47.162819    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6004ebc-9113-4142-be1e-1415e528c35c" path="/var/lib/kubelet/pods/e6004ebc-9113-4142-be1e-1415e528c35c/volumes"
Oct 30 21:17:48.038703 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:48.038664    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9" event={"ID":"eff7bc20-9396-4fd6-88ed-179f61d3c5e6","Type":"ContainerStarted","Data":"e3ede75b320c22f365ff767755605c3a267171f9f142357e4ec209302f857463"}
Oct 30 21:17:55.081132 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:55.081096    5937 generic.go:356] "Generic (PLEG): container finished" podID="eff7bc20-9396-4fd6-88ed-179f61d3c5e6" containerID="e3ede75b320c22f365ff767755605c3a267171f9f142357e4ec209302f857463" exitCode=0
Oct 30 21:17:55.081591 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:55.081158    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9" event={"ID":"eff7bc20-9396-4fd6-88ed-179f61d3c5e6","Type":"ContainerDied","Data":"e3ede75b320c22f365ff767755605c3a267171f9f142357e4ec209302f857463"}
Oct 30 21:17:56.209377 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:56.209352    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9"
Oct 30 21:17:57.032749 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.032715    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328"]
Oct 30 21:17:57.033086 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.033068    5937 cpu_manager.go:414] "containerMap: removing container" podUID="eff7bc20-9396-4fd6-88ed-179f61d3c5e6" containerName="curl"
Oct 30 21:17:57.033131 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.033087    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eff7bc20-9396-4fd6-88ed-179f61d3c5e6" containerName="curl"
Oct 30 21:17:57.033165 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.033153    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="eff7bc20-9396-4fd6-88ed-179f61d3c5e6" containerName="curl"
Oct 30 21:17:57.036141 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.036122    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328"
Oct 30 21:17:57.047300 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.047278    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328"
Oct 30 21:17:57.095926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.095889    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9" event={"ID":"eff7bc20-9396-4fd6-88ed-179f61d3c5e6","Type":"ContainerDied","Data":"3e7d42a559d532e5ec713a4c990a634d3a72f9aff874d9b17a18c79c729b91ea"}
Oct 30 21:17:57.096098 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.095940    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e7d42a559d532e5ec713a4c990a634d3a72f9aff874d9b17a18c79c729b91ea"
Oct 30 21:17:57.096098 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.095942    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9"
Oct 30 21:17:57.098120 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.098094    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328"]
Oct 30 21:17:57.431610 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.431517    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328"]
Oct 30 21:17:57.435032 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:17:57.434997    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50bd2d64_7f37_4605_a7db_badc203902ee.slice/crio-f885714ea6ad98a3a74e48a887dcdabf094008a76c9de59f880daf88c815d333 WatchSource:0}: Error finding container f885714ea6ad98a3a74e48a887dcdabf094008a76c9de59f880daf88c815d333: Status 404 returned error can't find the container with id f885714ea6ad98a3a74e48a887dcdabf094008a76c9de59f880daf88c815d333
Oct 30 21:17:57.710924 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.710889    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"]
Oct 30 21:17:57.714375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.714357    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:57.730980 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.730945    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-ta-internal\") pod \"data-science-collector-targetallocator-58d8cdd5df-pwrk8\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:57.731119 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.731028    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-58d8cdd5df-pwrk8\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:57.731177 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.731115    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88psl\" (UniqueName: \"kubernetes.io/projected/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-kube-api-access-88psl\") pod \"data-science-collector-targetallocator-58d8cdd5df-pwrk8\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:57.768027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.767980    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-ltdzb\""
Oct 30 21:17:57.768221 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.768048    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:17:57.818550 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.818509    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:17:57.819352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.819331    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"]
Oct 30 21:17:57.832002 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.831966    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-58d8cdd5df-pwrk8\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:57.832199 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.832086    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88psl\" (UniqueName: \"kubernetes.io/projected/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-kube-api-access-88psl\") pod \"data-science-collector-targetallocator-58d8cdd5df-pwrk8\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:57.832199 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.832157    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-ta-internal\") pod \"data-science-collector-targetallocator-58d8cdd5df-pwrk8\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:57.832885 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.832858    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-ta-internal\") pod \"data-science-collector-targetallocator-58d8cdd5df-pwrk8\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:57.834777 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.834759    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-58d8cdd5df-pwrk8\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:57.894657 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:57.894630    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88psl\" (UniqueName: \"kubernetes.io/projected/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-kube-api-access-88psl\") pod \"data-science-collector-targetallocator-58d8cdd5df-pwrk8\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:58.026123 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:58.026028    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:17:58.105323 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:58.105282    5937 generic.go:356] "Generic (PLEG): container finished" podID="50bd2d64-7f37-4605-a7db-badc203902ee" containerID="33fafd0e5b940923a9eeaa21f20f5339c0d5a9d13339a847b7ac17a59d3c3240" exitCode=0
Oct 30 21:17:58.105490 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:58.105338    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328" event={"ID":"50bd2d64-7f37-4605-a7db-badc203902ee","Type":"ContainerDied","Data":"33fafd0e5b940923a9eeaa21f20f5339c0d5a9d13339a847b7ac17a59d3c3240"}
Oct 30 21:17:58.105490 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:58.105405    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328" event={"ID":"50bd2d64-7f37-4605-a7db-badc203902ee","Type":"ContainerStarted","Data":"f885714ea6ad98a3a74e48a887dcdabf094008a76c9de59f880daf88c815d333"}
Oct 30 21:17:58.399667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:58.399578    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"]
Oct 30 21:17:58.402741 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:17:58.402713    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8f68ffc_3663_412e_a7d0_4373aa6dd3ff.slice/crio-3daa50d60b6f866f6398c55fb6fcc85f5115b7c9d3b78143ecfd14d79e3c3a82 WatchSource:0}: Error finding container 3daa50d60b6f866f6398c55fb6fcc85f5115b7c9d3b78143ecfd14d79e3c3a82: Status 404 returned error can't find the container with id 3daa50d60b6f866f6398c55fb6fcc85f5115b7c9d3b78143ecfd14d79e3c3a82
Oct 30 21:17:58.405106 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:58.405076    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:17:58.405177 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:58.405135    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:17:59.112520 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:59.112477    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8" event={"ID":"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff","Type":"ContainerStarted","Data":"9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67"}
Oct 30 21:17:59.112520 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:59.112530    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8" event={"ID":"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff","Type":"ContainerStarted","Data":"3daa50d60b6f866f6398c55fb6fcc85f5115b7c9d3b78143ecfd14d79e3c3a82"}
Oct 30 21:17:59.251709 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:59.251681    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328"
Oct 30 21:17:59.368717 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:17:59.368580    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8" podStartSLOduration=2.368561904 podStartE2EDuration="2.368561904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:59.233793807 +0000 UTC m=+2454.189808586" watchObservedRunningTime="2026-10-30 21:17:59.368561904 +0000 UTC m=+2454.324576681"
Oct 30 21:18:00.120084 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:00.120054    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328"
Oct 30 21:18:00.120527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:00.120102    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328" event={"ID":"50bd2d64-7f37-4605-a7db-badc203902ee","Type":"ContainerDied","Data":"f885714ea6ad98a3a74e48a887dcdabf094008a76c9de59f880daf88c815d333"}
Oct 30 21:18:00.120527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:00.120145    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f885714ea6ad98a3a74e48a887dcdabf094008a76c9de59f880daf88c815d333"
Oct 30 21:18:00.120527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:00.120252    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:18:00.122044 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:00.122024    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:18:11.523407 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:11.523368    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328"]
Oct 30 21:18:11.525312 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:11.525289    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/enrolled-inference-allowed-18e36b5213ed1328"]
Oct 30 21:18:11.574161 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:11.574119    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9"]
Oct 30 21:18:11.574806 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:11.574786    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["collector-namespace-auth-18e36b4f60efd942/unenrolled-spoof-denied-18e36b4fa079f6d9"]
Oct 30 21:18:13.161396 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:13.161360    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50bd2d64-7f37-4605-a7db-badc203902ee" path="/var/lib/kubelet/pods/50bd2d64-7f37-4605-a7db-badc203902ee/volumes"
Oct 30 21:18:13.161802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:13.161648    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eff7bc20-9396-4fd6-88ed-179f61d3c5e6" path="/var/lib/kubelet/pods/eff7bc20-9396-4fd6-88ed-179f61d3c5e6/volumes"
Oct 30 21:18:15.421262 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.421227    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"]
Oct 30 21:18:15.421669 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.421416    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx" podUID="23a42850-66f7-48db-a34b-fae2d39e28e0" containerName="thanos-querier" containerID="cri-o://3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3" gracePeriod=30
Oct 30 21:18:15.677631 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:18:15.675168    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:18:15.680139 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.680109    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"
Oct 30 21:18:15.756937 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.756908    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 21:18:15.757214 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.757187    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="prometheus" containerID="cri-o://79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669" gracePeriod=600
Oct 30 21:18:15.757291 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.757222    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="thanos-sidecar" containerID="cri-o://23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704" gracePeriod=600
Oct 30 21:18:15.757346 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.757222    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="config-reloader" containerID="cri-o://70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9" gracePeriod=600
Oct 30 21:18:15.793110 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.793076    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23a42850-66f7-48db-a34b-fae2d39e28e0-kube-api-access-2t4hr\" (UniqueName: \"kubernetes.io/projected/23a42850-66f7-48db-a34b-fae2d39e28e0-kube-api-access-2t4hr\") pod \"23a42850-66f7-48db-a34b-fae2d39e28e0\" (UID: \"23a42850-66f7-48db-a34b-fae2d39e28e0\") "
Oct 30 21:18:15.795676 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.795639    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a42850-66f7-48db-a34b-fae2d39e28e0-kube-api-access-2t4hr" pod "23a42850-66f7-48db-a34b-fae2d39e28e0" (UID: "23a42850-66f7-48db-a34b-fae2d39e28e0"). InnerVolumeSpecName "kube-api-access-2t4hr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:15.894566 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:15.894510    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t4hr\" (UniqueName: \"kubernetes.io/projected/23a42850-66f7-48db-a34b-fae2d39e28e0-kube-api-access-2t4hr\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.095683 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.095658    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:18:16.196872 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.196836    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.197083 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.196880    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-kube-api-access-2hpjt\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-kube-api-access-2hpjt\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.197083 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.196931    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.197083 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.196963    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config-out\" (UniqueName: \"kubernetes.io/empty-dir/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config-out\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.197083 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.196982    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-0\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.197083 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.197014    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-thanos-prometheus-http-client-file\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.197083 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.197045    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-2\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.197608 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.197466    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-2" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:16.197743 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.197619    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.197743 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.197615    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-0" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:16.198178 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.198146    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.198385 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.198366    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-1\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.198663 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.198645    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-secret-prometheus-web-tls-ca\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.198777 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.198752    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-1" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "prometheus-data-science-monitoringstack-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:16.198869 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.198854    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.198974 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.198961    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-tls-assets\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-tls-assets\") pod \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\" (UID: \"828cb003-2f33-4cc2-b355-b3d3cb64e05a\") "
Oct 30 21:18:16.199394 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.199375    5937 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-2\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.199502 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.199486    5937 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-1\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.199605 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.199506    5937 reconciler_common.go:299] "Volume detached for volume \"prometheus-data-science-monitoringstack-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/828cb003-2f33-4cc2-b355-b3d3cb64e05a-prometheus-data-science-monitoringstack-rulefiles-0\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.199957 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.199925    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "web-config-tls-secret-cert-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:16.200172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.200111    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-thanos-prometheus-http-client-file" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:16.200363 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.200316    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config-out" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:18:16.200363 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.200311    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-key-prometheus-operated-tls-f3457c70" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "web-config-tls-secret-key-prometheus-operated-tls-f3457c70". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:16.200521 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.200423    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-kube-api-access-2hpjt" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "kube-api-access-2hpjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:16.201819 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.201742    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:16.202026 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.202002    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-secret-prometheus-web-tls-ca" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "secret-prometheus-web-tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:16.202094 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.202034    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-tls-assets" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:16.203861 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.203839    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:18:16.215158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.215094    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config" pod "828cb003-2f33-4cc2-b355-b3d3cb64e05a" (UID: "828cb003-2f33-4cc2-b355-b3d3cb64e05a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:16.216231 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.216207    5937 generic.go:356] "Generic (PLEG): container finished" podID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerID="23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704" exitCode=0
Oct 30 21:18:16.216231 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.216229    5937 generic.go:356] "Generic (PLEG): container finished" podID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerID="70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9" exitCode=0
Oct 30 21:18:16.216231 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.216235    5937 generic.go:356] "Generic (PLEG): container finished" podID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerID="79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669" exitCode=0
Oct 30 21:18:16.216414 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.216271    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"
Oct 30 21:18:16.216414 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.216283    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerDied","Data":"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"}
Oct 30 21:18:16.216414 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.216348    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerDied","Data":"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"}
Oct 30 21:18:16.216414 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.216375    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerDied","Data":"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"}
Oct 30 21:18:16.216414 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.216398    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/prometheus-data-science-monitoringstack-1" event={"ID":"828cb003-2f33-4cc2-b355-b3d3cb64e05a","Type":"ContainerDied","Data":"c4fc930d5826609c7831d7fe937aff70775281c0092506ee7c7a23248a6dd5bc"}
Oct 30 21:18:16.216678 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.216413    5937 scope.go:122] "RemoveContainer" containerID="23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"
Oct 30 21:18:16.217879 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.217856    5937 generic.go:356] "Generic (PLEG): container finished" podID="23a42850-66f7-48db-a34b-fae2d39e28e0" containerID="3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3" exitCode=0
Oct 30 21:18:16.217977 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.217915    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"
Oct 30 21:18:16.217977 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.217930    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx" event={"ID":"23a42850-66f7-48db-a34b-fae2d39e28e0","Type":"ContainerDied","Data":"3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3"}
Oct 30 21:18:16.217977 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.217958    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx" event={"ID":"23a42850-66f7-48db-a34b-fae2d39e28e0","Type":"ContainerDied","Data":"dd59984eab2ae9d9ac2c916454834a60ce7b1fee509483d3f34760e1760cb92f"}
Oct 30 21:18:16.227802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.227762    5937 scope.go:122] "RemoveContainer" containerID="70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"
Oct 30 21:18:16.239886 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.239863    5937 scope.go:122] "RemoveContainer" containerID="79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"
Oct 30 21:18:16.250297 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.250274    5937 scope.go:122] "RemoveContainer" containerID="4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"
Oct 30 21:18:16.260865 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.260843    5937 scope.go:122] "RemoveContainer" containerID="23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"
Oct 30 21:18:16.261175 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:18:16.261154    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704\": container with ID starting with 23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704 not found: ID does not exist" containerID="23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"
Oct 30 21:18:16.261250 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.261188    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"} err="failed to get container status \"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704\": rpc error: code = NotFound desc = could not find container \"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704\": container with ID starting with 23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704 not found: ID does not exist"
Oct 30 21:18:16.261250 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.261216    5937 scope.go:122] "RemoveContainer" containerID="70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"
Oct 30 21:18:16.261507 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:18:16.261488    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9\": container with ID starting with 70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9 not found: ID does not exist" containerID="70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"
Oct 30 21:18:16.261608 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.261518    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"} err="failed to get container status \"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9\": rpc error: code = NotFound desc = could not find container \"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9\": container with ID starting with 70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9 not found: ID does not exist"
Oct 30 21:18:16.261608 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.261562    5937 scope.go:122] "RemoveContainer" containerID="79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"
Oct 30 21:18:16.261897 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:18:16.261877    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669\": container with ID starting with 79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669 not found: ID does not exist" containerID="79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"
Oct 30 21:18:16.261966 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.261902    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"} err="failed to get container status \"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669\": rpc error: code = NotFound desc = could not find container \"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669\": container with ID starting with 79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669 not found: ID does not exist"
Oct 30 21:18:16.261966 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.261916    5937 scope.go:122] "RemoveContainer" containerID="4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"
Oct 30 21:18:16.262193 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:18:16.262177    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589\": container with ID starting with 4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589 not found: ID does not exist" containerID="4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"
Oct 30 21:18:16.262256 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.262203    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"} err="failed to get container status \"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589\": rpc error: code = NotFound desc = could not find container \"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589\": container with ID starting with 4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589 not found: ID does not exist"
Oct 30 21:18:16.262256 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.262223    5937 scope.go:122] "RemoveContainer" containerID="23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"
Oct 30 21:18:16.262449 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.262432    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"} err="failed to get container status \"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704\": rpc error: code = NotFound desc = could not find container \"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704\": container with ID starting with 23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704 not found: ID does not exist"
Oct 30 21:18:16.262517 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.262450    5937 scope.go:122] "RemoveContainer" containerID="70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"
Oct 30 21:18:16.262694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.262674    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"} err="failed to get container status \"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9\": rpc error: code = NotFound desc = could not find container \"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9\": container with ID starting with 70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9 not found: ID does not exist"
Oct 30 21:18:16.262751 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.262698    5937 scope.go:122] "RemoveContainer" containerID="79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"
Oct 30 21:18:16.262952 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.262934    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"} err="failed to get container status \"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669\": rpc error: code = NotFound desc = could not find container \"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669\": container with ID starting with 79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669 not found: ID does not exist"
Oct 30 21:18:16.262996 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.262954    5937 scope.go:122] "RemoveContainer" containerID="4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"
Oct 30 21:18:16.263224 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.263199    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"} err="failed to get container status \"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589\": rpc error: code = NotFound desc = could not find container \"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589\": container with ID starting with 4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589 not found: ID does not exist"
Oct 30 21:18:16.263274 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.263229    5937 scope.go:122] "RemoveContainer" containerID="23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"
Oct 30 21:18:16.263581 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.263530    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704"} err="failed to get container status \"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704\": rpc error: code = NotFound desc = could not find container \"23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704\": container with ID starting with 23775ccfacd0f8fdb92dfdac0cceeef1be07b801f70246bc3a84390d06fbd704 not found: ID does not exist"
Oct 30 21:18:16.263656 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.263583    5937 scope.go:122] "RemoveContainer" containerID="70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"
Oct 30 21:18:16.263830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.263811    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9"} err="failed to get container status \"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9\": rpc error: code = NotFound desc = could not find container \"70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9\": container with ID starting with 70a65c5e38e5e5a9e32035fb22aadc6b95690dc696915a4e16cb8a48e78d3fe9 not found: ID does not exist"
Oct 30 21:18:16.263874 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.263831    5937 scope.go:122] "RemoveContainer" containerID="79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"
Oct 30 21:18:16.264041 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.264023    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669"} err="failed to get container status \"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669\": rpc error: code = NotFound desc = could not find container \"79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669\": container with ID starting with 79932707efe9c241c3099b6a63408108c55b025c6b414fe25117ddf936bde669 not found: ID does not exist"
Oct 30 21:18:16.264101 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.264041    5937 scope.go:122] "RemoveContainer" containerID="4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"
Oct 30 21:18:16.264289 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.264270    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589"} err="failed to get container status \"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589\": rpc error: code = NotFound desc = could not find container \"4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589\": container with ID starting with 4caf21b17c9daa218cef36260840a9ebb2ecbe7afe9ff0ceae323cdc15093589 not found: ID does not exist"
Oct 30 21:18:16.264289 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.264288    5937 scope.go:122] "RemoveContainer" containerID="3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3"
Oct 30 21:18:16.273152 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.273130    5937 scope.go:122] "RemoveContainer" containerID="3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3"
Oct 30 21:18:16.273407 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:18:16.273388    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3\": container with ID starting with 3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3 not found: ID does not exist" containerID="3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3"
Oct 30 21:18:16.273477 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.273417    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3"} err="failed to get container status \"3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3\": rpc error: code = NotFound desc = could not find container \"3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3\": container with ID starting with 3649ed6fb9449f7f0cf2253e29d1a746e9860316f5c474ba24d05c5146c334e3 not found: ID does not exist"
Oct 30 21:18:16.300149 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300115    5937 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-key-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-key-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.300149 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300145    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hpjt\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-kube-api-access-2hpjt\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.300378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300161    5937 reconciler_common.go:299] "Volume detached for volume \"web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config-tls-secret-cert-prometheus-operated-tls-f3457c70\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.300378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300175    5937 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config-out\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.300378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300187    5937 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.300378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300198    5937 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-web-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.300378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300235    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:18:16.300378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300252    5937 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-web-tls-ca\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-secret-prometheus-web-tls-ca\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.300378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300265    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/828cb003-2f33-4cc2-b355-b3d3cb64e05a-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.300378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.300279    5937 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/828cb003-2f33-4cc2-b355-b3d3cb64e05a-tls-assets\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:16.312073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.312055    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:18:16.401478 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.401442    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-fb65aa63-2762-435b-a8ef-8892b9ffe1f6\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0913d5896cba88aba\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-b22ad38bf3b4f4bc597b0714ae5f5e5b02f893b6e7c82d1e64089686a83f348c\""
Oct 30 21:18:16.446749 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.446719    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"]
Oct 30 21:18:16.450987 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.450963    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-hmtwx"]
Oct 30 21:18:16.564866 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.564789    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 21:18:16.568740 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:16.568717    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/prometheus-data-science-monitoringstack-1"]
Oct 30 21:18:17.160997 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:17.160955    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23a42850-66f7-48db-a34b-fae2d39e28e0" path="/var/lib/kubelet/pods/23a42850-66f7-48db-a34b-fae2d39e28e0/volumes"
Oct 30 21:18:17.161478 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:17.161458    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" path="/var/lib/kubelet/pods/828cb003-2f33-4cc2-b355-b3d3cb64e05a/volumes"
Oct 30 21:18:18.194369 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.194338    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"]
Oct 30 21:18:18.194854 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.194550    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8" podUID="a8f68ffc-3663-412e-a7d0-4373aa6dd3ff" containerName="ta-container" containerID="cri-o://9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67" gracePeriod=30
Oct 30 21:18:18.449234 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.449168    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:18:18.514525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.514490    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:18:18.514744 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.514705    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" containerName="perses" containerID="cri-o://de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655" gracePeriod=30
Oct 30 21:18:18.519799 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.519768    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-ta-internal\") pod \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") "
Oct 30 21:18:18.519980 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.519841    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-kube-api-access-88psl\" (UniqueName: \"kubernetes.io/projected/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-kube-api-access-88psl\") pod \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") "
Oct 30 21:18:18.519980 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.519883    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-data-science-collector-ta-server-cert\") pod \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\" (UID: \"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff\") "
Oct 30 21:18:18.520155 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.520133    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-ta-internal" pod "a8f68ffc-3663-412e-a7d0-4373aa6dd3ff" (UID: "a8f68ffc-3663-412e-a7d0-4373aa6dd3ff"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:18.522156 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.522131    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-kube-api-access-88psl" pod "a8f68ffc-3663-412e-a7d0-4373aa6dd3ff" (UID: "a8f68ffc-3663-412e-a7d0-4373aa6dd3ff"). InnerVolumeSpecName "kube-api-access-88psl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:18.522289 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.522274    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-data-science-collector-ta-server-cert" pod "a8f68ffc-3663-412e-a7d0-4373aa6dd3ff" (UID: "a8f68ffc-3663-412e-a7d0-4373aa6dd3ff"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:18:18.621287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.621236    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.621287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.621283    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88psl\" (UniqueName: \"kubernetes.io/projected/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-kube-api-access-88psl\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.621489 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.621301    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.754791 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.754764    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:18.823087 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.823048    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-plugins\" (UniqueName: \"kubernetes.io/empty-dir/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-plugins\") pod \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") "
Oct 30 21:18:18.823273 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.823130    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-config\" (UniqueName: \"kubernetes.io/configmap/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-config\") pod \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") "
Oct 30 21:18:18.823273 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.823214    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") "
Oct 30 21:18:18.823273 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.823242    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-kube-api-access-6jk2w\" (UniqueName: \"kubernetes.io/projected/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-kube-api-access-6jk2w\") pod \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\" (UID: \"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115\") "
Oct 30 21:18:18.823485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.823449    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-config" pod "969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" (UID: "969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:18:18.825641 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.825608    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-kube-api-access-6jk2w" pod "969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" (UID: "969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115"). InnerVolumeSpecName "kube-api-access-6jk2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:18:18.826178 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.826157    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" (UID: "969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:18:18.924552 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.924508    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.924729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.924578    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:18:18.924729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.924593    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jk2w\" (UniqueName: \"kubernetes.io/projected/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-kube-api-access-6jk2w\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:18.938097 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.938064    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:18:18.978903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:18.978862    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-plugins" pod "969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" (UID: "969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:18:19.025051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.024964    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:18:19.025051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.024995    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:18:19.236750 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.236715    5937 generic.go:356] "Generic (PLEG): container finished" podID="969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" containerID="de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655" exitCode=0
Oct 30 21:18:19.237197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.236763    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:19.237197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.236798    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115","Type":"ContainerDied","Data":"de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655"}
Oct 30 21:18:19.237197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.236846    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115","Type":"ContainerDied","Data":"05564e18a0598545dc86660fca6652104e00a9b853f519b8fe1d2be3c266f43d"}
Oct 30 21:18:19.237197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.236874    5937 scope.go:122] "RemoveContainer" containerID="de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655"
Oct 30 21:18:19.238351 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.238331    5937 generic.go:356] "Generic (PLEG): container finished" podID="a8f68ffc-3663-412e-a7d0-4373aa6dd3ff" containerID="9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67" exitCode=0
Oct 30 21:18:19.238433 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.238381    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8" event={"ID":"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff","Type":"ContainerDied","Data":"9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67"}
Oct 30 21:18:19.238433 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.238411    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8" event={"ID":"a8f68ffc-3663-412e-a7d0-4373aa6dd3ff","Type":"ContainerDied","Data":"3daa50d60b6f866f6398c55fb6fcc85f5115b7c9d3b78143ecfd14d79e3c3a82"}
Oct 30 21:18:19.238562 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.238410    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"
Oct 30 21:18:19.246800 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.246779    5937 scope.go:122] "RemoveContainer" containerID="de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655"
Oct 30 21:18:19.247131 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:18:19.247111    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655\": container with ID starting with de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655 not found: ID does not exist" containerID="de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655"
Oct 30 21:18:19.247172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.247140    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655"} err="failed to get container status \"de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655\": rpc error: code = NotFound desc = could not find container \"de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655\": container with ID starting with de5cb0c30f2b8068c10982cc301795fd93eb7a58a4915f7c0692d039462b6655 not found: ID does not exist"
Oct 30 21:18:19.247172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.247163    5937 scope.go:122] "RemoveContainer" containerID="9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67"
Oct 30 21:18:19.255598 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.255582    5937 scope.go:122] "RemoveContainer" containerID="9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67"
Oct 30 21:18:19.255872 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:18:19.255855    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67\": container with ID starting with 9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67 not found: ID does not exist" containerID="9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67"
Oct 30 21:18:19.255931 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.255882    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67"} err="failed to get container status \"9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67\": rpc error: code = NotFound desc = could not find container \"9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67\": container with ID starting with 9a316ce388b1539b9a5cbbcc8272866fd6f278580be59791eacc8e0038fdbb67 not found: ID does not exist"
Oct 30 21:18:19.402822 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.402737    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"]
Oct 30 21:18:19.453278 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.453250    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-58d8cdd5df-pwrk8"]
Oct 30 21:18:19.518684 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.518650    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:18:19.522245 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:19.522220    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:18:21.161363 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:21.161329    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" path="/var/lib/kubelet/pods/969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115/volumes"
Oct 30 21:18:21.161780 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:21.161764    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a8f68ffc-3663-412e-a7d0-4373aa6dd3ff" path="/var/lib/kubelet/pods/a8f68ffc-3663-412e-a7d0-4373aa6dd3ff/volumes"
Oct 30 21:18:28.769092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769058    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769407    5937 cpu_manager.go:414] "containerMap: removing container" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="init-config-reloader"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769418    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="init-config-reloader"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769427    5937 cpu_manager.go:414] "containerMap: removing container" podUID="50bd2d64-7f37-4605-a7db-badc203902ee" containerName="curl"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769431    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50bd2d64-7f37-4605-a7db-badc203902ee" containerName="curl"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769439    5937 cpu_manager.go:414] "containerMap: removing container" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="config-reloader"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769444    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="config-reloader"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769455    5937 cpu_manager.go:414] "containerMap: removing container" podUID="a8f68ffc-3663-412e-a7d0-4373aa6dd3ff" containerName="ta-container"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769459    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8f68ffc-3663-412e-a7d0-4373aa6dd3ff" containerName="ta-container"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769464    5937 cpu_manager.go:414] "containerMap: removing container" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="thanos-sidecar"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769469    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="thanos-sidecar"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769479    5937 cpu_manager.go:414] "containerMap: removing container" podUID="23a42850-66f7-48db-a34b-fae2d39e28e0" containerName="thanos-querier"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769483    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23a42850-66f7-48db-a34b-fae2d39e28e0" containerName="thanos-querier"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769493    5937 cpu_manager.go:414] "containerMap: removing container" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="prometheus"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769497    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="prometheus"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769506    5937 cpu_manager.go:414] "containerMap: removing container" podUID="969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" containerName="perses"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769511    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" containerName="perses"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769585    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8f68ffc-3663-412e-a7d0-4373aa6dd3ff" containerName="ta-container"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769593    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="thanos-sidecar"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769601    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="23a42850-66f7-48db-a34b-fae2d39e28e0" containerName="thanos-querier"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769607    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="prometheus"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769613    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="969f6eeb-03ac-49e9-b3e7-e6dbc4e0f115" containerName="perses"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769621    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="50bd2d64-7f37-4605-a7db-badc203902ee" containerName="curl"
Oct 30 21:18:28.769611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.769626    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="828cb003-2f33-4cc2-b355-b3d3cb64e05a" containerName="config-reloader"
Oct 30 21:18:28.790554 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.790512    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:28.845127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.845099    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:18:28.867118 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.867098    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:18:28.893773 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.893745    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:18:28.917771 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.917749    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:18:28.917771 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:28.917755    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:18:29.012364 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:29.012341    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-config\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:29.012511 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:29.012370    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-plugins\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:29.012612 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:29.012586    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7sxk\" (UniqueName: \"kubernetes.io/projected/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-kube-api-access-z7sxk\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:29.113736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:29.113685    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7sxk\" (UniqueName: \"kubernetes.io/projected/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-kube-api-access-z7sxk\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:29.113736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:29.113720    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-config\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:29.113874 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:29.113741    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-plugins\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:29.114106 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:29.114090    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-plugins\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:29.114282 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:29.114265    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-config\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:29.175887 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:29.175857    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7sxk\" (UniqueName: \"kubernetes.io/projected/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-kube-api-access-z7sxk\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:37.692966 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:37.692927    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:37.799700 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:37.799666    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:37.894034 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:37.894006    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:37.894194 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:37.894112    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:37.946990 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:37.946922    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:38.084779 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:38.084751    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:38.160527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:38.160500    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:38.401150 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:38.401121    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:38.772178 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:38.772138    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:18:38.775138 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:18:38.775110    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode43f3f0f_b62c_4718_bd0a_f6ae6d5d1f28.slice/crio-dbc923f46adf4b2315f55c6bf59e68f72890030571928b65e0124ed5c402b9c3 WatchSource:0}: Error finding container dbc923f46adf4b2315f55c6bf59e68f72890030571928b65e0124ed5c402b9c3: Status 404 returned error can't find the container with id dbc923f46adf4b2315f55c6bf59e68f72890030571928b65e0124ed5c402b9c3
Oct 30 21:18:39.354315 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:39.354276    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28","Type":"ContainerStarted","Data":"94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740"}
Oct 30 21:18:39.354315 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:39.354316    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28","Type":"ContainerStarted","Data":"dbc923f46adf4b2315f55c6bf59e68f72890030571928b65e0124ed5c402b9c3"}
Oct 30 21:18:39.354610 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:39.354342    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:18:39.473736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:39.473683    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=11.473667439 podStartE2EDuration="11.473667439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:18:39.473015859 +0000 UTC m=+2494.429030637" watchObservedRunningTime="2026-10-30 21:18:39.473667439 +0000 UTC m=+2494.429682209"
Oct 30 21:18:45.671290 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:18:45.671251    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:18:50.362993 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:18:50.362962    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:15.670050 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:19:15.669968    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:19:22.573557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.573507    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:19:22.574069 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.573740    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" containerName="perses" containerID="cri-o://94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740" gracePeriod=30
Oct 30 21:19:22.817667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.817643    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:22.870883 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.870819    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") "
Oct 30 21:19:22.870883 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.870873    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-kube-api-access-z7sxk\" (UniqueName: \"kubernetes.io/projected/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-kube-api-access-z7sxk\") pod \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") "
Oct 30 21:19:22.871060 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.870906    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-config\" (UniqueName: \"kubernetes.io/configmap/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-config\") pod \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") "
Oct 30 21:19:22.871430 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.871391    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-config" pod "e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" (UID: "e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:22.876313 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.876282    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-kube-api-access-z7sxk" pod "e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" (UID: "e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28"). InnerVolumeSpecName "kube-api-access-z7sxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:22.876585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.876563    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" (UID: "e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:19:22.971814 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.971789    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-plugins\") pod \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\" (UID: \"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28\") "
Oct 30 21:19:22.972053 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.972033    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7sxk\" (UniqueName: \"kubernetes.io/projected/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-kube-api-access-z7sxk\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:22.972100 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.972062    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:22.972135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.972098    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:19:22.986349 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:22.986327    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:19:23.073455 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.073426    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:19:23.118030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.117994    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-plugins" pod "e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" (UID: "e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:23.173833 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.173811    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:23.596977 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.596951    5937 generic.go:356] "Generic (PLEG): container finished" podID="e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" containerID="94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740" exitCode=0
Oct 30 21:19:23.597304 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.596995    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:23.597304 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.597040    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28","Type":"ContainerDied","Data":"94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740"}
Oct 30 21:19:23.597304 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.597079    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28","Type":"ContainerDied","Data":"dbc923f46adf4b2315f55c6bf59e68f72890030571928b65e0124ed5c402b9c3"}
Oct 30 21:19:23.597304 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.597096    5937 scope.go:122] "RemoveContainer" containerID="94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740"
Oct 30 21:19:23.606219 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.606201    5937 scope.go:122] "RemoveContainer" containerID="94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740"
Oct 30 21:19:23.606484 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:19:23.606467    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740\": container with ID starting with 94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740 not found: ID does not exist" containerID="94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740"
Oct 30 21:19:23.606547 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.606492    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740"} err="failed to get container status \"94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740\": rpc error: code = NotFound desc = could not find container \"94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740\": container with ID starting with 94f3ff11f63a90ca406a745c1eb859a5fed07b828858525fb7e2459e8a705740 not found: ID does not exist"
Oct 30 21:19:23.763073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.763048    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:19:23.813709 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:23.813680    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:19:25.161013 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:25.160982    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" path="/var/lib/kubelet/pods/e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28/volumes"
Oct 30 21:19:30.741986 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.741945    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:19:30.742367 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.742351    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" containerName="perses"
Oct 30 21:19:30.742410 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.742369    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" containerName="perses"
Oct 30 21:19:30.742448 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.742435    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e43f3f0f-b62c-4718-bd0a-f6ae6d5d1f28" containerName="perses"
Oct 30 21:19:30.745270 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.745252    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:30.849177 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.849143    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:19:30.849177 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.849162    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:19:30.849331 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.849154    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:19:30.849331 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.849146    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:19:30.849820 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:30.849806    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:19:31.038470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:31.038403    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5219c23f-9cab-42bb-b5f3-7754a380cbd7-config\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:31.038470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:31.038435    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkhbz\" (UniqueName: \"kubernetes.io/projected/5219c23f-9cab-42bb-b5f3-7754a380cbd7-kube-api-access-hkhbz\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:31.038470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:31.038471    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/5219c23f-9cab-42bb-b5f3-7754a380cbd7-plugins\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:31.139788 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:31.139754    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5219c23f-9cab-42bb-b5f3-7754a380cbd7-config\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:31.139788 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:31.139791    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkhbz\" (UniqueName: \"kubernetes.io/projected/5219c23f-9cab-42bb-b5f3-7754a380cbd7-kube-api-access-hkhbz\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:31.139969 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:31.139829    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/5219c23f-9cab-42bb-b5f3-7754a380cbd7-plugins\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:31.140152 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:31.140138    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/5219c23f-9cab-42bb-b5f3-7754a380cbd7-plugins\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:31.140408 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:31.140390    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5219c23f-9cab-42bb-b5f3-7754a380cbd7-config\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:31.203059 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:31.203033    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkhbz\" (UniqueName: \"kubernetes.io/projected/5219c23f-9cab-42bb-b5f3-7754a380cbd7-kube-api-access-hkhbz\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:37.294676 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:37.294643    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:37.402227 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:37.402189    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:37.496650 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:37.496619    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:37.496824 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:37.496760    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:37.552000 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:37.551912    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:37.693126 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:37.693091    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:37.762353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:37.762328    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:37.956512 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:37.956479    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:38.335916 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:38.335837    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:19:38.338693 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:19:38.338661    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5219c23f_9cab_42bb_b5f3_7754a380cbd7.slice/crio-4c6d83cc69c44255867f9cc54511c698aa089c67098740d90435157e605366e7 WatchSource:0}: Error finding container 4c6d83cc69c44255867f9cc54511c698aa089c67098740d90435157e605366e7: Status 404 returned error can't find the container with id 4c6d83cc69c44255867f9cc54511c698aa089c67098740d90435157e605366e7
Oct 30 21:19:38.676697 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:38.676606    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"5219c23f-9cab-42bb-b5f3-7754a380cbd7","Type":"ContainerStarted","Data":"fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e"}
Oct 30 21:19:38.676697 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:38.676652    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"5219c23f-9cab-42bb-b5f3-7754a380cbd7","Type":"ContainerStarted","Data":"4c6d83cc69c44255867f9cc54511c698aa089c67098740d90435157e605366e7"}
Oct 30 21:19:38.676697 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:38.676673    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:38.795785 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:38.795727    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=8.795708834 podStartE2EDuration="8.795708834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:19:38.794737311 +0000 UTC m=+2553.750752087" watchObservedRunningTime="2026-10-30 21:19:38.795708834 +0000 UTC m=+2553.751723608"
Oct 30 21:19:45.670611 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:19:45.670571    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:19:49.686043 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:49.686014    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:53.082137 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.082101    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:19:53.082601 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.082341    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="5219c23f-9cab-42bb-b5f3-7754a380cbd7" containerName="perses" containerID="cri-o://fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e" gracePeriod=30
Oct 30 21:19:53.340409 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.340346    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:53.423068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.423026    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5219c23f-9cab-42bb-b5f3-7754a380cbd7-plugins\" (UniqueName: \"kubernetes.io/empty-dir/5219c23f-9cab-42bb-b5f3-7754a380cbd7-plugins\") pod \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") "
Oct 30 21:19:53.423268 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.423189    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") "
Oct 30 21:19:53.423268 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.423237    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5219c23f-9cab-42bb-b5f3-7754a380cbd7-config\" (UniqueName: \"kubernetes.io/configmap/5219c23f-9cab-42bb-b5f3-7754a380cbd7-config\") pod \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") "
Oct 30 21:19:53.423403 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.423290    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5219c23f-9cab-42bb-b5f3-7754a380cbd7-kube-api-access-hkhbz\" (UniqueName: \"kubernetes.io/projected/5219c23f-9cab-42bb-b5f3-7754a380cbd7-kube-api-access-hkhbz\") pod \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\" (UID: \"5219c23f-9cab-42bb-b5f3-7754a380cbd7\") "
Oct 30 21:19:53.423687 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.423658    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5219c23f-9cab-42bb-b5f3-7754a380cbd7-config" pod "5219c23f-9cab-42bb-b5f3-7754a380cbd7" (UID: "5219c23f-9cab-42bb-b5f3-7754a380cbd7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:19:53.425776 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.425741    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5219c23f-9cab-42bb-b5f3-7754a380cbd7-kube-api-access-hkhbz" pod "5219c23f-9cab-42bb-b5f3-7754a380cbd7" (UID: "5219c23f-9cab-42bb-b5f3-7754a380cbd7"). InnerVolumeSpecName "kube-api-access-hkhbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:19:53.426128 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.426109    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "5219c23f-9cab-42bb-b5f3-7754a380cbd7" (UID: "5219c23f-9cab-42bb-b5f3-7754a380cbd7"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:19:53.524621 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.524590    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:19:53.524621 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.524621    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5219c23f-9cab-42bb-b5f3-7754a380cbd7-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:53.524822 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.524633    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkhbz\" (UniqueName: \"kubernetes.io/projected/5219c23f-9cab-42bb-b5f3-7754a380cbd7-kube-api-access-hkhbz\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:53.538077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.538053    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:19:53.575894 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.575857    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5219c23f-9cab-42bb-b5f3-7754a380cbd7-plugins" pod "5219c23f-9cab-42bb-b5f3-7754a380cbd7" (UID: "5219c23f-9cab-42bb-b5f3-7754a380cbd7"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:19:53.625765 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.625692    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/5219c23f-9cab-42bb-b5f3-7754a380cbd7-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:19:53.625765 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.625719    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:19:53.756090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.756054    5937 generic.go:356] "Generic (PLEG): container finished" podID="5219c23f-9cab-42bb-b5f3-7754a380cbd7" containerID="fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e" exitCode=0
Oct 30 21:19:53.756239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.756097    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:19:53.756239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.756125    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"5219c23f-9cab-42bb-b5f3-7754a380cbd7","Type":"ContainerDied","Data":"fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e"}
Oct 30 21:19:53.756239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.756174    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"5219c23f-9cab-42bb-b5f3-7754a380cbd7","Type":"ContainerDied","Data":"4c6d83cc69c44255867f9cc54511c698aa089c67098740d90435157e605366e7"}
Oct 30 21:19:53.756239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.756215    5937 scope.go:122] "RemoveContainer" containerID="fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e"
Oct 30 21:19:53.766407 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.766386    5937 scope.go:122] "RemoveContainer" containerID="fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e"
Oct 30 21:19:53.766723 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:19:53.766700    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e\": container with ID starting with fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e not found: ID does not exist" containerID="fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e"
Oct 30 21:19:53.766775 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.766734    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e"} err="failed to get container status \"fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e\": rpc error: code = NotFound desc = could not find container \"fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e\": container with ID starting with fc60e22d629eaa28304d7bdc18aef2830c6a686ccef41150d725d1b309dd130e not found: ID does not exist"
Oct 30 21:19:53.922952 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.922870    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:19:53.929089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:53.929066    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:19:55.161440 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:19:55.161406    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5219c23f-9cab-42bb-b5f3-7754a380cbd7" path="/var/lib/kubelet/pods/5219c23f-9cab-42bb-b5f3-7754a380cbd7/volumes"
Oct 30 21:20:01.359926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.359893    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:20:01.360298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.360228    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5219c23f-9cab-42bb-b5f3-7754a380cbd7" containerName="perses"
Oct 30 21:20:01.360298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.360238    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5219c23f-9cab-42bb-b5f3-7754a380cbd7" containerName="perses"
Oct 30 21:20:01.360298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.360297    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5219c23f-9cab-42bb-b5f3-7754a380cbd7" containerName="perses"
Oct 30 21:20:01.363120 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.363100    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:01.421236 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.421208    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:20:01.467991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.467967    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:20:01.468101 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.468081    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:20:01.468154 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.468143    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:20:01.468193 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.468176    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:20:01.585495 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.585464    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e697d9d6-0e7b-492b-8878-8080d5c3aabe-config\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:01.585675 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.585501    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e697d9d6-0e7b-492b-8878-8080d5c3aabe-plugins\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:01.585675 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.585522    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbr2g\" (UniqueName: \"kubernetes.io/projected/e697d9d6-0e7b-492b-8878-8080d5c3aabe-kube-api-access-wbr2g\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:01.686381 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.686297    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e697d9d6-0e7b-492b-8878-8080d5c3aabe-config\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:01.686381 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.686338    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e697d9d6-0e7b-492b-8878-8080d5c3aabe-plugins\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:01.686381 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.686362    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbr2g\" (UniqueName: \"kubernetes.io/projected/e697d9d6-0e7b-492b-8878-8080d5c3aabe-kube-api-access-wbr2g\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:01.686772 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.686749    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e697d9d6-0e7b-492b-8878-8080d5c3aabe-plugins\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:01.686891 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.686874    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e697d9d6-0e7b-492b-8878-8080d5c3aabe-config\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:01.749391 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:01.749360    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbr2g\" (UniqueName: \"kubernetes.io/projected/e697d9d6-0e7b-492b-8878-8080d5c3aabe-kube-api-access-wbr2g\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:05.617240 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:05.617205    5937 scope.go:122] "RemoveContainer" containerID="a0c08bf3eb8154720f2243ff6c4b35490415b8b14964f1f5eb93df88b16d8267"
Oct 30 21:20:05.626033 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:05.626016    5937 scope.go:122] "RemoveContainer" containerID="4f67ba1e360ac63af5b54ff07108c3170ab9fc0fc2037cce8d1675aa3c7beb39"
Oct 30 21:20:08.547162 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:08.547129    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:08.654096 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:08.654064    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:08.748968 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:08.748941    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:08.749116 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:08.749082    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:08.802461 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:08.802385    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:08.943176 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:08.943148    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:09.014775 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:09.014744    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:09.226719 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:09.226698    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:20:09.234848 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:09.234823    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:09.607220 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:09.607137    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:20:09.610320 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:20:09.610292    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode697d9d6_0e7b_492b_8878_8080d5c3aabe.slice/crio-4a7e62f96ae5250bc3f13ea4bfa25c33a87684c600f214a06b5f2c35c3822565 WatchSource:0}: Error finding container 4a7e62f96ae5250bc3f13ea4bfa25c33a87684c600f214a06b5f2c35c3822565: Status 404 returned error can't find the container with id 4a7e62f96ae5250bc3f13ea4bfa25c33a87684c600f214a06b5f2c35c3822565
Oct 30 21:20:09.841392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:09.841358    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e697d9d6-0e7b-492b-8878-8080d5c3aabe","Type":"ContainerStarted","Data":"cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2"}
Oct 30 21:20:09.841392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:09.841398    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e697d9d6-0e7b-492b-8878-8080d5c3aabe","Type":"ContainerStarted","Data":"4a7e62f96ae5250bc3f13ea4bfa25c33a87684c600f214a06b5f2c35c3822565"}
Oct 30 21:20:09.841672 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:09.841462    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:09.961158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:09.960976    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=8.960960235 podStartE2EDuration="8.960960235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:20:09.960897886 +0000 UTC m=+2584.916912664" watchObservedRunningTime="2026-10-30 21:20:09.960960235 +0000 UTC m=+2584.916975009"
Oct 30 21:20:15.671085 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:20:15.671051    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:20:20.849474 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:20.849444    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:45.672039 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:20:45.671953    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:20:53.068003 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.067973    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:20:53.068554 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.068199    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="e697d9d6-0e7b-492b-8878-8080d5c3aabe" containerName="perses" containerID="cri-o://cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2" gracePeriod=30
Oct 30 21:20:53.307344 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.307320    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:53.334100 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.334049    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e697d9d6-0e7b-492b-8878-8080d5c3aabe-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e697d9d6-0e7b-492b-8878-8080d5c3aabe-plugins\") pod \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") "
Oct 30 21:20:53.334100 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.334084    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e697d9d6-0e7b-492b-8878-8080d5c3aabe-config\" (UniqueName: \"kubernetes.io/configmap/e697d9d6-0e7b-492b-8878-8080d5c3aabe-config\") pod \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") "
Oct 30 21:20:53.334279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.334108    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e697d9d6-0e7b-492b-8878-8080d5c3aabe-kube-api-access-wbr2g\" (UniqueName: \"kubernetes.io/projected/e697d9d6-0e7b-492b-8878-8080d5c3aabe-kube-api-access-wbr2g\") pod \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") "
Oct 30 21:20:53.334279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.334198    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\" (UID: \"e697d9d6-0e7b-492b-8878-8080d5c3aabe\") "
Oct 30 21:20:53.334461 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.334438    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e697d9d6-0e7b-492b-8878-8080d5c3aabe-config" pod "e697d9d6-0e7b-492b-8878-8080d5c3aabe" (UID: "e697d9d6-0e7b-492b-8878-8080d5c3aabe"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:20:53.334588 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.334497    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e697d9d6-0e7b-492b-8878-8080d5c3aabe-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.336383 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.336354    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e697d9d6-0e7b-492b-8878-8080d5c3aabe-kube-api-access-wbr2g" pod "e697d9d6-0e7b-492b-8878-8080d5c3aabe" (UID: "e697d9d6-0e7b-492b-8878-8080d5c3aabe"). InnerVolumeSpecName "kube-api-access-wbr2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:20:53.337042 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.337021    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "e697d9d6-0e7b-492b-8878-8080d5c3aabe" (UID: "e697d9d6-0e7b-492b-8878-8080d5c3aabe"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:20:53.435914 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.435885    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbr2g\" (UniqueName: \"kubernetes.io/projected/e697d9d6-0e7b-492b-8878-8080d5c3aabe-kube-api-access-wbr2g\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.436076 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.435930    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:20:53.450288 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.450269    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:20:53.489642 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.489612    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e697d9d6-0e7b-492b-8878-8080d5c3aabe-plugins" pod "e697d9d6-0e7b-492b-8878-8080d5c3aabe" (UID: "e697d9d6-0e7b-492b-8878-8080d5c3aabe"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:20:53.536703 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.536664    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e697d9d6-0e7b-492b-8878-8080d5c3aabe-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:20:53.536703 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:53.536699    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:20:54.062098 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:54.062068    5937 generic.go:356] "Generic (PLEG): container finished" podID="e697d9d6-0e7b-492b-8878-8080d5c3aabe" containerID="cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2" exitCode=0
Oct 30 21:20:54.062301 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:54.062119    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:20:54.062301 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:54.062146    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e697d9d6-0e7b-492b-8878-8080d5c3aabe","Type":"ContainerDied","Data":"cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2"}
Oct 30 21:20:54.062301 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:54.062193    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e697d9d6-0e7b-492b-8878-8080d5c3aabe","Type":"ContainerDied","Data":"4a7e62f96ae5250bc3f13ea4bfa25c33a87684c600f214a06b5f2c35c3822565"}
Oct 30 21:20:54.062301 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:54.062215    5937 scope.go:122] "RemoveContainer" containerID="cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2"
Oct 30 21:20:54.071997 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:54.071808    5937 scope.go:122] "RemoveContainer" containerID="cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2"
Oct 30 21:20:54.072229 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:20:54.072071    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2\": container with ID starting with cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2 not found: ID does not exist" containerID="cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2"
Oct 30 21:20:54.072229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:54.072093    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2"} err="failed to get container status \"cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2\": rpc error: code = NotFound desc = could not find container \"cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2\": container with ID starting with cb130e5165c312a6108b381a2952ee284b10e01e4b898a01f289519e3e43fda2 not found: ID does not exist"
Oct 30 21:20:54.227060 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:54.227037    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:20:54.277829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:54.277802    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:20:55.161276 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:20:55.161244    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e697d9d6-0e7b-492b-8878-8080d5c3aabe" path="/var/lib/kubelet/pods/e697d9d6-0e7b-492b-8878-8080d5c3aabe/volumes"
Oct 30 21:21:00.522166 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.522132    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:21:00.522559 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.522474    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e697d9d6-0e7b-492b-8878-8080d5c3aabe" containerName="perses"
Oct 30 21:21:00.522559 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.522483    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e697d9d6-0e7b-492b-8878-8080d5c3aabe" containerName="perses"
Oct 30 21:21:00.522559 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.522558    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e697d9d6-0e7b-492b-8878-8080d5c3aabe" containerName="perses"
Oct 30 21:21:00.525314 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.525298    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:00.585023 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.584994    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:21:00.592122 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.592098    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-data\") pod \"seaweedfs\" (UID: \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:00.592274 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.592131    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdqqq\" (UniqueName: \"kubernetes.io/projected/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-kube-api-access-xdqqq\") pod \"seaweedfs\" (UID: \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:00.631073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.631049    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:21:00.631073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.631063    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:21:00.631195 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.631049    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:21:00.693362 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.693330    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-data\") pod \"seaweedfs\" (UID: \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:00.693498 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.693372    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdqqq\" (UniqueName: \"kubernetes.io/projected/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-kube-api-access-xdqqq\") pod \"seaweedfs\" (UID: \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:00.693720 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.693700    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-data\") pod \"seaweedfs\" (UID: \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:00.755640 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.755615    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdqqq\" (UniqueName: \"kubernetes.io/projected/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-kube-api-access-xdqqq\") pod \"seaweedfs\" (UID: \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:00.836578 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:00.836502    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:01.205436 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:01.205408    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:21:01.208730 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:21:01.208700    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ab23f9f_4ac1_4e5b_a4e3_9aabbcf68965.slice/crio-2558535b1b62f5b95a39d3ad0c392aff839434aeaa77653351ff500dcc0c101d WatchSource:0}: Error finding container 2558535b1b62f5b95a39d3ad0c392aff839434aeaa77653351ff500dcc0c101d: Status 404 returned error can't find the container with id 2558535b1b62f5b95a39d3ad0c392aff839434aeaa77653351ff500dcc0c101d
Oct 30 21:21:01.210629 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:01.210613    5937 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:21:02.105503 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:02.105465    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965","Type":"ContainerStarted","Data":"2558535b1b62f5b95a39d3ad0c392aff839434aeaa77653351ff500dcc0c101d"}
Oct 30 21:21:05.660040 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:05.660010    5937 scope.go:122] "RemoveContainer" containerID="3053d2bd08a2043e655f8faeb1d822a3653944fbdfa1ff747f941129380839a6"
Oct 30 21:21:05.668957 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:05.668939    5937 scope.go:122] "RemoveContainer" containerID="f6ef683cfd9a15ddd36b4ab511fde6071788923f2187c73d621043dd4946d48c"
Oct 30 21:21:05.677347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:05.677331    5937 scope.go:122] "RemoveContainer" containerID="d4221455c4c58f47795ed2d0ad61f6e110d28ce4c70748e5ee1c1db3c078ed29"
Oct 30 21:21:05.685602 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:05.685578    5937 scope.go:122] "RemoveContainer" containerID="8fc63ff44e2902ac4177436778490008445e229565fca73500f3afa918669041"
Oct 30 21:21:05.694790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:05.694767    5937 scope.go:122] "RemoveContainer" containerID="7dc27abb4fd9eaa1b7087772a592ccc161e7862c4e25aff332e2aee2e5544b28"
Oct 30 21:21:05.709362 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:05.703675    5937 scope.go:122] "RemoveContainer" containerID="522f3f1d3de691e6fc19f8a833ff9915003b0da2550bf5c58019cc56feaa0f9d"
Oct 30 21:21:12.158010 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:12.157970    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965","Type":"ContainerStarted","Data":"6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb"}
Oct 30 21:21:12.158412 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:12.158036    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:12.276703 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:12.276650    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/seaweedfs" podStartSLOduration=1.425419204 podStartE2EDuration="12.27663651s" totalImagesPullingTime="10.851217306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:12.276042871 +0000 UTC m=+2647.232057649" watchObservedRunningTime="2026-10-30 21:21:12.27663651 +0000 UTC m=+2647.232651321"
Oct 30 21:21:15.671092 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:21:15.671043    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:21:23.165086 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:23.165056    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:21:24.885111 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:24.885079    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:21:24.889828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:24.889784    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:21:24.942788 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:24.942762    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:21:24.997857 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:24.997830    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tcjg\" (UniqueName: \"kubernetes.io/projected/2b48332a-8766-4bfa-8924-f1c21babb220-kube-api-access-9tcjg\") pod \"seaweedfs-bucket-creator\" (UID: \"2b48332a-8766-4bfa-8924-f1c21babb220\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:21:25.099232 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:25.099204    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tcjg\" (UniqueName: \"kubernetes.io/projected/2b48332a-8766-4bfa-8924-f1c21babb220-kube-api-access-9tcjg\") pod \"seaweedfs-bucket-creator\" (UID: \"2b48332a-8766-4bfa-8924-f1c21babb220\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:21:25.162147 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:25.162085    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tcjg\" (UniqueName: \"kubernetes.io/projected/2b48332a-8766-4bfa-8924-f1c21babb220-kube-api-access-9tcjg\") pod \"seaweedfs-bucket-creator\" (UID: \"2b48332a-8766-4bfa-8924-f1c21babb220\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:21:25.201862 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:25.201838    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:21:25.575960 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:25.575930    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:21:25.578966 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:21:25.578926    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b48332a_8766_4bfa_8924_f1c21babb220.slice/crio-9f390af5fa3045ccd1bbb7d92ed6df2d6b6aaf37a9df7ab41c1753c6872baa87 WatchSource:0}: Error finding container 9f390af5fa3045ccd1bbb7d92ed6df2d6b6aaf37a9df7ab41c1753c6872baa87: Status 404 returned error can't find the container with id 9f390af5fa3045ccd1bbb7d92ed6df2d6b6aaf37a9df7ab41c1753c6872baa87
Oct 30 21:21:26.226590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:26.226559    5937 generic.go:356] "Generic (PLEG): container finished" podID="2b48332a-8766-4bfa-8924-f1c21babb220" containerID="de87d3a701e1ae31cf38d8da7c7ba807b52b19bd354b05af222145e536e2820b" exitCode=0
Oct 30 21:21:26.226923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:26.226637    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"2b48332a-8766-4bfa-8924-f1c21babb220","Type":"ContainerDied","Data":"de87d3a701e1ae31cf38d8da7c7ba807b52b19bd354b05af222145e536e2820b"}
Oct 30 21:21:26.226923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:26.226674    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"2b48332a-8766-4bfa-8924-f1c21babb220","Type":"ContainerStarted","Data":"9f390af5fa3045ccd1bbb7d92ed6df2d6b6aaf37a9df7ab41c1753c6872baa87"}
Oct 30 21:21:27.361623 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:27.361601    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:21:27.520124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:27.520057    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b48332a-8766-4bfa-8924-f1c21babb220-kube-api-access-9tcjg\" (UniqueName: \"kubernetes.io/projected/2b48332a-8766-4bfa-8924-f1c21babb220-kube-api-access-9tcjg\") pod \"2b48332a-8766-4bfa-8924-f1c21babb220\" (UID: \"2b48332a-8766-4bfa-8924-f1c21babb220\") "
Oct 30 21:21:27.522254 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:27.522234    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b48332a-8766-4bfa-8924-f1c21babb220-kube-api-access-9tcjg" pod "2b48332a-8766-4bfa-8924-f1c21babb220" (UID: "2b48332a-8766-4bfa-8924-f1c21babb220"). InnerVolumeSpecName "kube-api-access-9tcjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:27.621695 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:27.621668    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tcjg\" (UniqueName: \"kubernetes.io/projected/2b48332a-8766-4bfa-8924-f1c21babb220-kube-api-access-9tcjg\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:28.236498 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:28.236462    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:21:28.236498 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:28.236490    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"2b48332a-8766-4bfa-8924-f1c21babb220","Type":"ContainerDied","Data":"9f390af5fa3045ccd1bbb7d92ed6df2d6b6aaf37a9df7ab41c1753c6872baa87"}
Oct 30 21:21:28.236728 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:28.236520    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f390af5fa3045ccd1bbb7d92ed6df2d6b6aaf37a9df7ab41c1753c6872baa87"
Oct 30 21:21:33.758990 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.758959    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:21:33.759438 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.759420    5937 cpu_manager.go:414] "containerMap: removing container" podUID="2b48332a-8766-4bfa-8924-f1c21babb220" containerName="create-bucket"
Oct 30 21:21:33.759491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.759440    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b48332a-8766-4bfa-8924-f1c21babb220" containerName="create-bucket"
Oct 30 21:21:33.759528 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.759510    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b48332a-8766-4bfa-8924-f1c21babb220" containerName="create-bucket"
Oct 30 21:21:33.762606 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.762587    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:33.820817 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.820789    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:21:33.867844 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.867821    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:21:33.969343 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.969313    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtl6k\" (UniqueName: \"kubernetes.io/projected/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-kube-api-access-mtl6k\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:33.969500 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.969384    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-plugins\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:33.969500 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:33.969455    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-config\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:34.070656 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:34.070582    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtl6k\" (UniqueName: \"kubernetes.io/projected/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-kube-api-access-mtl6k\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:34.070799 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:34.070664    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-plugins\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:34.070799 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:34.070702    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-config\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:34.071074 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:34.071054    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-plugins\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:34.071346 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:34.071325    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-config\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:34.137988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:34.137967    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtl6k\" (UniqueName: \"kubernetes.io/projected/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-kube-api-access-mtl6k\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:40.828865 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:40.828830    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:40.935070 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:40.935042    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:41.031517 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:41.031488    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:41.031663 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:41.031638    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:41.084774 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:41.084713    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:41.225401 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:41.225372    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:41.294040 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:41.294015    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:41.574363 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:41.574332    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:41.950127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:41.949942    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:21:41.952764 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:21:41.952732    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bfdd0a6_e213_4be2_a4d5_421a71f0897b.slice/crio-9f3899ecba0f9268cf6b629a15ef7e7241ac6091d9005985e19b40263083b796 WatchSource:0}: Error finding container 9f3899ecba0f9268cf6b629a15ef7e7241ac6091d9005985e19b40263083b796: Status 404 returned error can't find the container with id 9f3899ecba0f9268cf6b629a15ef7e7241ac6091d9005985e19b40263083b796
Oct 30 21:21:42.308584 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:42.308525    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"6bfdd0a6-e213-4be2-a4d5-421a71f0897b","Type":"ContainerStarted","Data":"eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16"}
Oct 30 21:21:42.308787 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:42.308598    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"6bfdd0a6-e213-4be2-a4d5-421a71f0897b","Type":"ContainerStarted","Data":"9f3899ecba0f9268cf6b629a15ef7e7241ac6091d9005985e19b40263083b796"}
Oct 30 21:21:42.308787 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:42.308670    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:21:42.425852 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:42.425795    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=9.425778128 podStartE2EDuration="9.425778128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:42.425583739 +0000 UTC m=+2677.381598516" watchObservedRunningTime="2026-10-30 21:21:42.425778128 +0000 UTC m=+2677.381792905"
Oct 30 21:21:45.670946 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:21:45.670912    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:21:53.316927 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:21:53.316896    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:22:05.756732 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:05.756703    5937 scope.go:122] "RemoveContainer" containerID="411e9eb6b7253b9a10a2ea801da1c43a468d18f20ce5d09b9fdeb105a42e0db5"
Oct 30 21:22:05.765594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:05.765573    5937 scope.go:122] "RemoveContainer" containerID="fda56bcc30752d9df895ce57cf6b1d6e1f21fd7d0f73611b0a5b68a13862084b"
Oct 30 21:22:05.773453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:05.773437    5937 scope.go:122] "RemoveContainer" containerID="a789a8fb368be7093a4f3a84251e3459b1d6b6b9aa6bb8185f444730782b8d41"
Oct 30 21:22:05.780970 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:05.780952    5937 scope.go:122] "RemoveContainer" containerID="ca61e6976bd1ee00cb53ce5fd52aaa77c24f17990a369316513bb2c3f0b75cd2"
Oct 30 21:22:05.788371 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:05.788356    5937 scope.go:122] "RemoveContainer" containerID="10b6ee3b555e85f9adef9032c4ed6f28131e0ae3345e6324e2fcd1569c562370"
Oct 30 21:22:15.670766 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:22:15.670676    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:22:45.671105 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:22:45.671063    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:22:55.794618 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:55.794583    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:22:55.795619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:55.794837    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="6bfdd0a6-e213-4be2-a4d5-421a71f0897b" containerName="perses" containerID="cri-o://eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16" gracePeriod=30
Oct 30 21:22:56.047561 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.047472    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:22:56.144773 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.144745    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-config\" (UniqueName: \"kubernetes.io/configmap/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-config\") pod \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") "
Oct 30 21:22:56.144900 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.144783    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-kube-api-access-mtl6k\" (UniqueName: \"kubernetes.io/projected/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-kube-api-access-mtl6k\") pod \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") "
Oct 30 21:22:56.144900 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.144870    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") "
Oct 30 21:22:56.144993 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.144939    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-plugins\" (UniqueName: \"kubernetes.io/empty-dir/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-plugins\") pod \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\" (UID: \"6bfdd0a6-e213-4be2-a4d5-421a71f0897b\") "
Oct 30 21:22:56.145091 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.145066    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-config" pod "6bfdd0a6-e213-4be2-a4d5-421a71f0897b" (UID: "6bfdd0a6-e213-4be2-a4d5-421a71f0897b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:22:56.147032 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.147009    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-kube-api-access-mtl6k" pod "6bfdd0a6-e213-4be2-a4d5-421a71f0897b" (UID: "6bfdd0a6-e213-4be2-a4d5-421a71f0897b"). InnerVolumeSpecName "kube-api-access-mtl6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:22:56.147662 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.147643    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "6bfdd0a6-e213-4be2-a4d5-421a71f0897b" (UID: "6bfdd0a6-e213-4be2-a4d5-421a71f0897b"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:22:56.246359 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.246327    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:56.246601 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.246581    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtl6k\" (UniqueName: \"kubernetes.io/projected/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-kube-api-access-mtl6k\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:56.246770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.246748    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:22:56.261570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.261533    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:22:56.315727 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.315654    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-plugins" pod "6bfdd0a6-e213-4be2-a4d5-421a71f0897b" (UID: "6bfdd0a6-e213-4be2-a4d5-421a71f0897b"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:22:56.347305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.347268    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:22:56.347305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.347300    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/6bfdd0a6-e213-4be2-a4d5-421a71f0897b-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:56.680864 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.680777    5937 generic.go:356] "Generic (PLEG): container finished" podID="6bfdd0a6-e213-4be2-a4d5-421a71f0897b" containerID="eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16" exitCode=0
Oct 30 21:22:56.680864 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.680823    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:22:56.680864 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.680855    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"6bfdd0a6-e213-4be2-a4d5-421a71f0897b","Type":"ContainerDied","Data":"eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16"}
Oct 30 21:22:56.681151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.680897    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"6bfdd0a6-e213-4be2-a4d5-421a71f0897b","Type":"ContainerDied","Data":"9f3899ecba0f9268cf6b629a15ef7e7241ac6091d9005985e19b40263083b796"}
Oct 30 21:22:56.681151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.680915    5937 scope.go:122] "RemoveContainer" containerID="eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16"
Oct 30 21:22:56.690281 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.690263    5937 scope.go:122] "RemoveContainer" containerID="eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16"
Oct 30 21:22:56.690562 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:22:56.690528    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16\": container with ID starting with eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16 not found: ID does not exist" containerID="eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16"
Oct 30 21:22:56.690619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.690568    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16"} err="failed to get container status \"eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16\": rpc error: code = NotFound desc = could not find container \"eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16\": container with ID starting with eef91ee687311c2be436b489209a9a811a8b8d192804098eef78a79898167c16 not found: ID does not exist"
Oct 30 21:22:56.848792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.848745    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:22:56.850279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:56.850259    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:22:57.161408 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:57.161377    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6bfdd0a6-e213-4be2-a4d5-421a71f0897b" path="/var/lib/kubelet/pods/6bfdd0a6-e213-4be2-a4d5-421a71f0897b/volumes"
Oct 30 21:22:58.443244 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:58.443211    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:22:58.447425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:58.447402    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:22:58.493915 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:58.493894    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:22:58.494067 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:58.494047    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/seaweedfs" podUID="6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965" containerName="seaweedfs" containerID="cri-o://6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb" gracePeriod=30
Oct 30 21:22:59.161323 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:22:59.161294    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b48332a-8766-4bfa-8924-f1c21babb220" path="/var/lib/kubelet/pods/2b48332a-8766-4bfa-8924-f1c21babb220/volumes"
Oct 30 21:23:05.822468 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.822439    5937 scope.go:122] "RemoveContainer" containerID="f390c3cd8c8c3ac20c511a4d84724cf7fcf15f0449d726fc93ef6b9d9d7c9773"
Oct 30 21:23:05.830994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.830974    5937 scope.go:122] "RemoveContainer" containerID="76f9500949ccb424c9a38f56702de32e1452cd4bc9d622f95f5df168d24986df"
Oct 30 21:23:05.838430 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.838411    5937 scope.go:122] "RemoveContainer" containerID="eea2c1e1bbaedeb80105551f0f2d50fe3090b500752fc539cdac1944e00c4049"
Oct 30 21:23:05.845737 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.845717    5937 scope.go:122] "RemoveContainer" containerID="d179cffe3eac7a69f2749adc65679a85268393a9572a16a9b76170f518cf284d"
Oct 30 21:23:05.853208 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.853191    5937 scope.go:122] "RemoveContainer" containerID="2f4e423d2e135f670c8095ce5c973d60e2784e5d60a9f747979bf1ffac811124"
Oct 30 21:23:05.860115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.860095    5937 scope.go:122] "RemoveContainer" containerID="b5b372edd3da69181fd9aef7519dbd2ca8a996c9bb16d0a963f1f16feadb707f"
Oct 30 21:23:05.866950 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.866934    5937 scope.go:122] "RemoveContainer" containerID="7ade76c93ed223ae3fc10a5f0221b01f78b25427570a9b33b8fa5c1cf87dcb20"
Oct 30 21:23:05.873893 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.873864    5937 scope.go:122] "RemoveContainer" containerID="2fd16eac81c5cc21a610af994c14bd464b7ceeb090b2ee846ca4eac7ef0b3117"
Oct 30 21:23:05.880788 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.880770    5937 scope.go:122] "RemoveContainer" containerID="3cd8fc8dbd5edd2adb769848a3fb1a878f22f8784853d4b5780bbe0c9f7e5032"
Oct 30 21:23:05.890152 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.889647    5937 scope.go:122] "RemoveContainer" containerID="dc4d23ae63b6c9ac82f29dddc6ea9cf233495d092590f21eca8eae4947854aa3"
Oct 30 21:23:05.897375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:05.897360    5937 scope.go:122] "RemoveContainer" containerID="d9c0967ee6d1baf30b44b3fee6ed6672ffa581ba5c0d87277a67310869f1c0bd"
Oct 30 21:23:15.671684 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:23:15.671641    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:23:23.750487 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.750462    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:23:23.779923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.779868    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-data\" (UniqueName: \"kubernetes.io/empty-dir/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-data\") pod \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\" (UID: \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\") "
Oct 30 21:23:23.779923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.779905    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-kube-api-access-xdqqq\" (UniqueName: \"kubernetes.io/projected/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-kube-api-access-xdqqq\") pod \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\" (UID: \"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965\") "
Oct 30 21:23:23.780834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.780809    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-data" pod "6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965" (UID: "6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:23:23.782082 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.782054    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-kube-api-access-xdqqq" pod "6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965" (UID: "6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965"). InnerVolumeSpecName "kube-api-access-xdqqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:23.810993 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.810969    5937 generic.go:356] "Generic (PLEG): container finished" podID="6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965" containerID="6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb" exitCode=0
Oct 30 21:23:23.811127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.811013    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:23:23.811127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.811057    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965","Type":"ContainerDied","Data":"6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb"}
Oct 30 21:23:23.811127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.811105    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965","Type":"ContainerDied","Data":"2558535b1b62f5b95a39d3ad0c392aff839434aeaa77653351ff500dcc0c101d"}
Oct 30 21:23:23.811294 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.811127    5937 scope.go:122] "RemoveContainer" containerID="6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb"
Oct 30 21:23:23.820048 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.820029    5937 scope.go:122] "RemoveContainer" containerID="6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb"
Oct 30 21:23:23.820307 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:23:23.820288    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb\": container with ID starting with 6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb not found: ID does not exist" containerID="6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb"
Oct 30 21:23:23.820375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.820322    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb"} err="failed to get container status \"6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb\": rpc error: code = NotFound desc = could not find container \"6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb\": container with ID starting with 6e7bd36be381aab3e815094dc9d7ef2fb7a843851c0bb3c0d8e646cc9646c2cb not found: ID does not exist"
Oct 30 21:23:23.881235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.881200    5937 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-data\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:23.881235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.881239    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdqqq\" (UniqueName: \"kubernetes.io/projected/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965-kube-api-access-xdqqq\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:23.980098 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.980064    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:23:23.984222 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:23.984194    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:23:25.160837 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:25.160806    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965" path="/var/lib/kubelet/pods/6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965/volumes"
Oct 30 21:23:29.151147 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.151116    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 21:23:29.151653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.151444    5937 cpu_manager.go:414] "containerMap: removing container" podUID="6bfdd0a6-e213-4be2-a4d5-421a71f0897b" containerName="perses"
Oct 30 21:23:29.151653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.151454    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6bfdd0a6-e213-4be2-a4d5-421a71f0897b" containerName="perses"
Oct 30 21:23:29.151653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.151469    5937 cpu_manager.go:414] "containerMap: removing container" podUID="6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965" containerName="seaweedfs"
Oct 30 21:23:29.151653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.151474    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965" containerName="seaweedfs"
Oct 30 21:23:29.151653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.151551    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ab23f9f-4ac1-4e5b-a4e3-9aabbcf68965" containerName="seaweedfs"
Oct 30 21:23:29.151653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.151564    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="6bfdd0a6-e213-4be2-a4d5-421a71f0897b" containerName="perses"
Oct 30 21:23:29.153892 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.153875    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:29.222291 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.222264    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/34fc5e19-daa0-4e44-86a7-9650208c4125-data\") pod \"fake-gcs-server\" (UID: \"34fc5e19-daa0-4e44-86a7-9650208c4125\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:29.222457 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.222330    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzxmz\" (UniqueName: \"kubernetes.io/projected/34fc5e19-daa0-4e44-86a7-9650208c4125-kube-api-access-fzxmz\") pod \"fake-gcs-server\" (UID: \"34fc5e19-daa0-4e44-86a7-9650208c4125\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:29.257495 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.257471    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:23:29.259948 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.259928    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:23:29.260047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.260026    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:23:29.260652 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.260633    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 21:23:29.322810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.322788    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzxmz\" (UniqueName: \"kubernetes.io/projected/34fc5e19-daa0-4e44-86a7-9650208c4125-kube-api-access-fzxmz\") pod \"fake-gcs-server\" (UID: \"34fc5e19-daa0-4e44-86a7-9650208c4125\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:29.322912 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.322834    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/34fc5e19-daa0-4e44-86a7-9650208c4125-data\") pod \"fake-gcs-server\" (UID: \"34fc5e19-daa0-4e44-86a7-9650208c4125\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:29.323173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.323154    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/34fc5e19-daa0-4e44-86a7-9650208c4125-data\") pod \"fake-gcs-server\" (UID: \"34fc5e19-daa0-4e44-86a7-9650208c4125\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:29.385299 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.385270    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzxmz\" (UniqueName: \"kubernetes.io/projected/34fc5e19-daa0-4e44-86a7-9650208c4125-kube-api-access-fzxmz\") pod \"fake-gcs-server\" (UID: \"34fc5e19-daa0-4e44-86a7-9650208c4125\") " pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:29.464105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.464068    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:29.830167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:29.830099    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 21:23:29.833418 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:23:29.833392    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34fc5e19_daa0_4e44_86a7_9650208c4125.slice/crio-a5b8207a0a2ba47d6aa4a7394f7fbfc64eeadbae038f91783220038c8140ae8e WatchSource:0}: Error finding container a5b8207a0a2ba47d6aa4a7394f7fbfc64eeadbae038f91783220038c8140ae8e: Status 404 returned error can't find the container with id a5b8207a0a2ba47d6aa4a7394f7fbfc64eeadbae038f91783220038c8140ae8e
Oct 30 21:23:30.842520 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:30.842438    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"34fc5e19-daa0-4e44-86a7-9650208c4125","Type":"ContainerStarted","Data":"a5b8207a0a2ba47d6aa4a7394f7fbfc64eeadbae038f91783220038c8140ae8e"}
Oct 30 21:23:32.856046 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:32.856009    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"34fc5e19-daa0-4e44-86a7-9650208c4125","Type":"ContainerStarted","Data":"318a901fbe044b212790d7dbc093356439aec39b3639da0e5350c37ceb2f125f"}
Oct 30 21:23:32.856449 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:32.856213    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:32.976922 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:32.976873    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/fake-gcs-server" podStartSLOduration=1.722192584 podStartE2EDuration="3.976858762s" totalImagesPullingTime="2.254666178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:32.974015216 +0000 UTC m=+2787.930029992" watchObservedRunningTime="2026-10-30 21:23:32.976858762 +0000 UTC m=+2787.932873538"
Oct 30 21:23:38.864233 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:38.864203    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:23:39.383279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:39.383239    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 21:23:39.386796 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:39.386779    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 21:23:39.441026 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:39.440989    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 21:23:39.508839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:39.508799    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl2rd\" (UniqueName: \"kubernetes.io/projected/acdbc20e-2236-4d98-837d-c96bbe0d3519-kube-api-access-hl2rd\") pod \"fake-gcs-bucket-creator\" (UID: \"acdbc20e-2236-4d98-837d-c96bbe0d3519\") " pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 21:23:39.609257 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:39.609217    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl2rd\" (UniqueName: \"kubernetes.io/projected/acdbc20e-2236-4d98-837d-c96bbe0d3519-kube-api-access-hl2rd\") pod \"fake-gcs-bucket-creator\" (UID: \"acdbc20e-2236-4d98-837d-c96bbe0d3519\") " pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 21:23:39.673090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:39.673014    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl2rd\" (UniqueName: \"kubernetes.io/projected/acdbc20e-2236-4d98-837d-c96bbe0d3519-kube-api-access-hl2rd\") pod \"fake-gcs-bucket-creator\" (UID: \"acdbc20e-2236-4d98-837d-c96bbe0d3519\") " pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 21:23:39.701258 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:39.701226    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 21:23:40.069653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:40.069622    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 21:23:40.072281 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:23:40.072253    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacdbc20e_2236_4d98_837d_c96bbe0d3519.slice/crio-d43a4e5f1f808a74a8626429c109e740e3b648b24aeff85d0266bff9da0a16c0 WatchSource:0}: Error finding container d43a4e5f1f808a74a8626429c109e740e3b648b24aeff85d0266bff9da0a16c0: Status 404 returned error can't find the container with id d43a4e5f1f808a74a8626429c109e740e3b648b24aeff85d0266bff9da0a16c0
Oct 30 21:23:40.893886 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:40.893855    5937 generic.go:356] "Generic (PLEG): container finished" podID="acdbc20e-2236-4d98-837d-c96bbe0d3519" containerID="0cba8db0e2ceb8eeaf423a569ce9d8a8ff8d48e85e99cf198a6deb601eecbad5" exitCode=0
Oct 30 21:23:40.894046 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:40.893898    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-bucket-creator" event={"ID":"acdbc20e-2236-4d98-837d-c96bbe0d3519","Type":"ContainerDied","Data":"0cba8db0e2ceb8eeaf423a569ce9d8a8ff8d48e85e99cf198a6deb601eecbad5"}
Oct 30 21:23:40.894046 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:40.893924    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-bucket-creator" event={"ID":"acdbc20e-2236-4d98-837d-c96bbe0d3519","Type":"ContainerStarted","Data":"d43a4e5f1f808a74a8626429c109e740e3b648b24aeff85d0266bff9da0a16c0"}
Oct 30 21:23:42.028173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:42.028149    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 21:23:42.132405 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:42.132362    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/acdbc20e-2236-4d98-837d-c96bbe0d3519-kube-api-access-hl2rd\" (UniqueName: \"kubernetes.io/projected/acdbc20e-2236-4d98-837d-c96bbe0d3519-kube-api-access-hl2rd\") pod \"acdbc20e-2236-4d98-837d-c96bbe0d3519\" (UID: \"acdbc20e-2236-4d98-837d-c96bbe0d3519\") "
Oct 30 21:23:42.134583 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:42.134557    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acdbc20e-2236-4d98-837d-c96bbe0d3519-kube-api-access-hl2rd" pod "acdbc20e-2236-4d98-837d-c96bbe0d3519" (UID: "acdbc20e-2236-4d98-837d-c96bbe0d3519"). InnerVolumeSpecName "kube-api-access-hl2rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:23:42.233165 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:42.233124    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl2rd\" (UniqueName: \"kubernetes.io/projected/acdbc20e-2236-4d98-837d-c96bbe0d3519-kube-api-access-hl2rd\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:23:42.903391 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:42.903353    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-bucket-creator" event={"ID":"acdbc20e-2236-4d98-837d-c96bbe0d3519","Type":"ContainerDied","Data":"d43a4e5f1f808a74a8626429c109e740e3b648b24aeff85d0266bff9da0a16c0"}
Oct 30 21:23:42.903391 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:42.903388    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-bucket-creator"
Oct 30 21:23:42.903642 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:42.903395    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d43a4e5f1f808a74a8626429c109e740e3b648b24aeff85d0266bff9da0a16c0"
Oct 30 21:23:45.672049 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:23:45.671961    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:23:48.076353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.076322    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:23:48.076764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.076660    5937 cpu_manager.go:414] "containerMap: removing container" podUID="acdbc20e-2236-4d98-837d-c96bbe0d3519" containerName="create-bucket"
Oct 30 21:23:48.076764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.076672    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="acdbc20e-2236-4d98-837d-c96bbe0d3519" containerName="create-bucket"
Oct 30 21:23:48.076838 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.076767    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="acdbc20e-2236-4d98-837d-c96bbe0d3519" containerName="create-bucket"
Oct 30 21:23:48.079857 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.079839    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:48.137701 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.137675    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:23:48.188203 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.188171    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:23:48.287303 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.287270    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbjxq\" (UniqueName: \"kubernetes.io/projected/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-kube-api-access-bbjxq\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:48.287488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.287343    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-plugins\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:48.287488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.287444    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-config\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:48.388419 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.388357    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-config\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:48.388515 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.388438    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbjxq\" (UniqueName: \"kubernetes.io/projected/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-kube-api-access-bbjxq\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:48.388515 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.388500    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-plugins\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:48.388891 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.388869    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-plugins\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:48.389101 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.389086    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-config\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:48.451262 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:48.451228    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbjxq\" (UniqueName: \"kubernetes.io/projected/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-kube-api-access-bbjxq\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:54.237257 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:54.237224    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:54.343332 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:54.343307    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:54.439599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:54.439566    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:54.439749 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:54.439716    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:54.493928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:54.493855    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:54.635606 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:54.635577    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:54.704643 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:54.704610    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:54.991354 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:54.991323    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:23:55.365466 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:55.365367    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:23:55.368356 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:23:55.368330    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82ccda7b_3b86_49ba_a1a3_cc662fcf06a0.slice/crio-63de3aad1e77d9051186c5c7830e449d01923e7ad8ca295bba2095b00cdae440 WatchSource:0}: Error finding container 63de3aad1e77d9051186c5c7830e449d01923e7ad8ca295bba2095b00cdae440: Status 404 returned error can't find the container with id 63de3aad1e77d9051186c5c7830e449d01923e7ad8ca295bba2095b00cdae440
Oct 30 21:23:55.966364 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:55.966328    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0","Type":"ContainerStarted","Data":"e6489610c7d9bd0b22a5d7421fbd21eeb32b132e6dabf44315a113c0a86a9f9d"}
Oct 30 21:23:55.966632 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:55.966381    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0","Type":"ContainerStarted","Data":"63de3aad1e77d9051186c5c7830e449d01923e7ad8ca295bba2095b00cdae440"}
Oct 30 21:23:55.966752 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:23:55.966654    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:24:05.952823 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:24:05.952794    5937 scope.go:122] "RemoveContainer" containerID="440bdc5335533a758c72f2a22668e08477f1d5bafb02704ecda303a48acbf579"
Oct 30 21:24:05.962043 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:24:05.962022    5937 scope.go:122] "RemoveContainer" containerID="33fafd0e5b940923a9eeaa21f20f5339c0d5a9d13339a847b7ac17a59d3c3240"
Oct 30 21:24:05.971275 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:24:05.971254    5937 scope.go:122] "RemoveContainer" containerID="fc784d3b3f322a3407b86a4bbbaf57dc1d3c615a1cc2848b080d6532bc92471d"
Oct 30 21:24:05.981796 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:24:05.981662    5937 scope.go:122] "RemoveContainer" containerID="1d39267b9cf6e34528209eebba6a0a6edeef8a508ea392a01b09566370febf00"
Oct 30 21:24:05.990184 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:24:05.990160    5937 scope.go:122] "RemoveContainer" containerID="e3ede75b320c22f365ff767755605c3a267171f9f142357e4ec209302f857463"
Oct 30 21:24:05.997877 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:24:05.997857    5937 scope.go:122] "RemoveContainer" containerID="3960808d6078497a46448ed154d02350df741f5361a25b3882cd762160c557d5"
Oct 30 21:24:06.005785 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:24:06.005761    5937 scope.go:122] "RemoveContainer" containerID="b3d2c0689d522220822766ecddd1f59bf63731c6d8fc383153f77fc1ec3254c8"
Oct 30 21:24:06.974147 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:24:06.974115    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:24:07.092210 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:24:07.092161    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=19.092146213 podStartE2EDuration="19.092146213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:56.084792364 +0000 UTC m=+2811.040807144" watchObservedRunningTime="2026-10-30 21:24:07.092146213 +0000 UTC m=+2822.048160991"
Oct 30 21:24:15.672633 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:24:15.672587    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:24:45.670366 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:24:45.670330    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:25:15.671040 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:25:15.670947    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:25:38.272159 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.272126    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:25:38.272753 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.272336    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" containerName="perses" containerID="cri-o://e6489610c7d9bd0b22a5d7421fbd21eeb32b132e6dabf44315a113c0a86a9f9d" gracePeriod=30
Oct 30 21:25:38.408142 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.408115    5937 generic.go:356] "Generic (PLEG): container finished" podID="82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" containerID="e6489610c7d9bd0b22a5d7421fbd21eeb32b132e6dabf44315a113c0a86a9f9d" exitCode=0
Oct 30 21:25:38.408301 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.408194    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0","Type":"ContainerDied","Data":"e6489610c7d9bd0b22a5d7421fbd21eeb32b132e6dabf44315a113c0a86a9f9d"}
Oct 30 21:25:38.521828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.521806    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:38.616405 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.616347    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-plugins\" (UniqueName: \"kubernetes.io/empty-dir/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-plugins\") pod \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") "
Oct 30 21:25:38.616556 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.616446    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") "
Oct 30 21:25:38.616556 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.616517    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-kube-api-access-bbjxq\" (UniqueName: \"kubernetes.io/projected/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-kube-api-access-bbjxq\") pod \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") "
Oct 30 21:25:38.616709 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.616563    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-config\" (UniqueName: \"kubernetes.io/configmap/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-config\") pod \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\" (UID: \"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0\") "
Oct 30 21:25:38.617054 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.617011    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-config" pod "82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" (UID: "82ccda7b-3b86-49ba-a1a3-cc662fcf06a0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:25:38.618805 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.618781    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-kube-api-access-bbjxq" pod "82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" (UID: "82ccda7b-3b86-49ba-a1a3-cc662fcf06a0"). InnerVolumeSpecName "kube-api-access-bbjxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:38.619183 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.619162    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" (UID: "82ccda7b-3b86-49ba-a1a3-cc662fcf06a0"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:25:38.717853 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.717822    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbjxq\" (UniqueName: \"kubernetes.io/projected/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-kube-api-access-bbjxq\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:38.717853 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.717848    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:38.718053 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.717878    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:25:38.731318 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.731292    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:25:38.780949 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.780850    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-plugins" pod "82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" (UID: "82ccda7b-3b86-49ba-a1a3-cc662fcf06a0"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:38.819004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.818971    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:38.819004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:38.818999    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:25:39.413366 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:39.413340    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:39.413765 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:39.413339    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"82ccda7b-3b86-49ba-a1a3-cc662fcf06a0","Type":"ContainerDied","Data":"63de3aad1e77d9051186c5c7830e449d01923e7ad8ca295bba2095b00cdae440"}
Oct 30 21:25:39.413765 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:39.413465    5937 scope.go:122] "RemoveContainer" containerID="e6489610c7d9bd0b22a5d7421fbd21eeb32b132e6dabf44315a113c0a86a9f9d"
Oct 30 21:25:39.580676 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:39.580632    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:25:39.585789 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:39.585766    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:25:41.161735 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.161695    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" path="/var/lib/kubelet/pods/82ccda7b-3b86-49ba-a1a3-cc662fcf06a0/volumes"
Oct 30 21:25:41.214130 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.214103    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 21:25:41.218277 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.218254    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/fake-gcs-bucket-creator"]
Oct 30 21:25:41.264763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.264735    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 21:25:41.264930 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.264909    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/fake-gcs-server" podUID="34fc5e19-daa0-4e44-86a7-9650208c4125" containerName="fake-gcs-server" containerID="cri-o://318a901fbe044b212790d7dbc093356439aec39b3639da0e5350c37ceb2f125f" gracePeriod=30
Oct 30 21:25:41.423158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.423081    5937 generic.go:356] "Generic (PLEG): container finished" podID="34fc5e19-daa0-4e44-86a7-9650208c4125" containerID="318a901fbe044b212790d7dbc093356439aec39b3639da0e5350c37ceb2f125f" exitCode=0
Oct 30 21:25:41.423158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.423146    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"34fc5e19-daa0-4e44-86a7-9650208c4125","Type":"ContainerDied","Data":"318a901fbe044b212790d7dbc093356439aec39b3639da0e5350c37ceb2f125f"}
Oct 30 21:25:41.507245 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.507223    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:25:41.640741 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.640716    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/34fc5e19-daa0-4e44-86a7-9650208c4125-data\" (UniqueName: \"kubernetes.io/empty-dir/34fc5e19-daa0-4e44-86a7-9650208c4125-data\") pod \"34fc5e19-daa0-4e44-86a7-9650208c4125\" (UID: \"34fc5e19-daa0-4e44-86a7-9650208c4125\") "
Oct 30 21:25:41.640878 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.640760    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/34fc5e19-daa0-4e44-86a7-9650208c4125-kube-api-access-fzxmz\" (UniqueName: \"kubernetes.io/projected/34fc5e19-daa0-4e44-86a7-9650208c4125-kube-api-access-fzxmz\") pod \"34fc5e19-daa0-4e44-86a7-9650208c4125\" (UID: \"34fc5e19-daa0-4e44-86a7-9650208c4125\") "
Oct 30 21:25:41.641113 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.641086    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34fc5e19-daa0-4e44-86a7-9650208c4125-data" pod "34fc5e19-daa0-4e44-86a7-9650208c4125" (UID: "34fc5e19-daa0-4e44-86a7-9650208c4125"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:25:41.642810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.642779    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34fc5e19-daa0-4e44-86a7-9650208c4125-kube-api-access-fzxmz" pod "34fc5e19-daa0-4e44-86a7-9650208c4125" (UID: "34fc5e19-daa0-4e44-86a7-9650208c4125"). InnerVolumeSpecName "kube-api-access-fzxmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:41.741942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.741916    5937 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/34fc5e19-daa0-4e44-86a7-9650208c4125-data\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:41.741942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:41.741941    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzxmz\" (UniqueName: \"kubernetes.io/projected/34fc5e19-daa0-4e44-86a7-9650208c4125-kube-api-access-fzxmz\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:42.428458 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:42.428423    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/fake-gcs-server" event={"ID":"34fc5e19-daa0-4e44-86a7-9650208c4125","Type":"ContainerDied","Data":"a5b8207a0a2ba47d6aa4a7394f7fbfc64eeadbae038f91783220038c8140ae8e"}
Oct 30 21:25:42.428921 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:42.428462    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/fake-gcs-server"
Oct 30 21:25:42.428921 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:42.428467    5937 scope.go:122] "RemoveContainer" containerID="318a901fbe044b212790d7dbc093356439aec39b3639da0e5350c37ceb2f125f"
Oct 30 21:25:42.594614 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:42.594585    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 21:25:42.598709 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:42.598685    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/fake-gcs-server"]
Oct 30 21:25:43.165663 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:43.165631    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="34fc5e19-daa0-4e44-86a7-9650208c4125" path="/var/lib/kubelet/pods/34fc5e19-daa0-4e44-86a7-9650208c4125/volumes"
Oct 30 21:25:43.165930 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:43.165918    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="acdbc20e-2236-4d98-837d-c96bbe0d3519" path="/var/lib/kubelet/pods/acdbc20e-2236-4d98-837d-c96bbe0d3519/volumes"
Oct 30 21:25:45.670752 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:25:45.670714    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:25:49.023077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.023044    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:25:49.023502 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.023362    5937 cpu_manager.go:414] "containerMap: removing container" podUID="34fc5e19-daa0-4e44-86a7-9650208c4125" containerName="fake-gcs-server"
Oct 30 21:25:49.023502 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.023373    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="34fc5e19-daa0-4e44-86a7-9650208c4125" containerName="fake-gcs-server"
Oct 30 21:25:49.023502 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.023399    5937 cpu_manager.go:414] "containerMap: removing container" podUID="82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" containerName="perses"
Oct 30 21:25:49.023502 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.023405    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" containerName="perses"
Oct 30 21:25:49.023502 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.023460    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="34fc5e19-daa0-4e44-86a7-9650208c4125" containerName="fake-gcs-server"
Oct 30 21:25:49.023502 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.023470    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="82ccda7b-3b86-49ba-a1a3-cc662fcf06a0" containerName="perses"
Oct 30 21:25:49.027598 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.027580    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:49.086766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.086735    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:25:49.136607 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.136584    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:25:49.138497 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.138481    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:25:49.138666 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.138652    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:25:49.138706 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.138669    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:25:49.310801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.310707    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/27d35261-c163-4f27-8761-c78b3594e4c6-plugins\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:49.310801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.310759    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7gl9\" (UniqueName: \"kubernetes.io/projected/27d35261-c163-4f27-8761-c78b3594e4c6-kube-api-access-g7gl9\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:49.310997 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.310888    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27d35261-c163-4f27-8761-c78b3594e4c6-config\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:49.411935 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.411885    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/27d35261-c163-4f27-8761-c78b3594e4c6-plugins\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:49.411935 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.411946    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7gl9\" (UniqueName: \"kubernetes.io/projected/27d35261-c163-4f27-8761-c78b3594e4c6-kube-api-access-g7gl9\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:49.412166 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.412005    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27d35261-c163-4f27-8761-c78b3594e4c6-config\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:49.412369 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.412349    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/27d35261-c163-4f27-8761-c78b3594e4c6-plugins\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:49.412649 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.412633    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27d35261-c163-4f27-8761-c78b3594e4c6-config\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:49.475505 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:49.475475    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7gl9\" (UniqueName: \"kubernetes.io/projected/27d35261-c163-4f27-8761-c78b3594e4c6-kube-api-access-g7gl9\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:56.877517 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:56.877484    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:56.983827 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:56.983791    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:57.078956 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:57.078924    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:57.079123 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:57.079050    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:57.132402 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:57.132330    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:57.272066 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:57.272036    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:57.341694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:57.341668    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:57.438916 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:57.438862    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:57.809193 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:57.809159    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:25:57.815235 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:25:57.815206    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27d35261_c163_4f27_8761_c78b3594e4c6.slice/crio-08382db9f99eb3548b4e45ab88a16394122523358f95372fcd31ae075b081d8e WatchSource:0}: Error finding container 08382db9f99eb3548b4e45ab88a16394122523358f95372fcd31ae075b081d8e: Status 404 returned error can't find the container with id 08382db9f99eb3548b4e45ab88a16394122523358f95372fcd31ae075b081d8e
Oct 30 21:25:58.509423 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:58.509387    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"27d35261-c163-4f27-8761-c78b3594e4c6","Type":"ContainerStarted","Data":"0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422"}
Oct 30 21:25:58.509423 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:58.509427    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"27d35261-c163-4f27-8761-c78b3594e4c6","Type":"ContainerStarted","Data":"08382db9f99eb3548b4e45ab88a16394122523358f95372fcd31ae075b081d8e"}
Oct 30 21:25:58.509922 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:58.509561    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:25:58.627374 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:25:58.627305    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=10.627285372 podStartE2EDuration="10.627285372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:25:58.626945358 +0000 UTC m=+2933.582960147" watchObservedRunningTime="2026-10-30 21:25:58.627285372 +0000 UTC m=+2933.583300150"
Oct 30 21:26:09.515651 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:09.515621    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:13.300232 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.300199    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:26:13.300680 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.300415    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="27d35261-c163-4f27-8761-c78b3594e4c6" containerName="perses" containerID="cri-o://0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422" gracePeriod=30
Oct 30 21:26:13.539295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.539272    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:13.578021 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.577960    5937 generic.go:356] "Generic (PLEG): container finished" podID="27d35261-c163-4f27-8761-c78b3594e4c6" containerID="0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422" exitCode=0
Oct 30 21:26:13.578021 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.578002    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:13.578159 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.578015    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"27d35261-c163-4f27-8761-c78b3594e4c6","Type":"ContainerDied","Data":"0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422"}
Oct 30 21:26:13.578159 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.578056    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"27d35261-c163-4f27-8761-c78b3594e4c6","Type":"ContainerDied","Data":"08382db9f99eb3548b4e45ab88a16394122523358f95372fcd31ae075b081d8e"}
Oct 30 21:26:13.578159 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.578075    5937 scope.go:122] "RemoveContainer" containerID="0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422"
Oct 30 21:26:13.586109 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.586093    5937 scope.go:122] "RemoveContainer" containerID="0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422"
Oct 30 21:26:13.586357 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:26:13.586338    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422\": container with ID starting with 0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422 not found: ID does not exist" containerID="0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422"
Oct 30 21:26:13.586406 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.586364    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422"} err="failed to get container status \"0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422\": rpc error: code = NotFound desc = could not find container \"0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422\": container with ID starting with 0b7632babd1a22d018d4a106d2a10163c05e2ac5e9c3911bf7e40db5ee814422 not found: ID does not exist"
Oct 30 21:26:13.623202 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.623176    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/27d35261-c163-4f27-8761-c78b3594e4c6-plugins\" (UniqueName: \"kubernetes.io/empty-dir/27d35261-c163-4f27-8761-c78b3594e4c6-plugins\") pod \"27d35261-c163-4f27-8761-c78b3594e4c6\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") "
Oct 30 21:26:13.623342 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.623328    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"27d35261-c163-4f27-8761-c78b3594e4c6\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") "
Oct 30 21:26:13.623412 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.623363    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/27d35261-c163-4f27-8761-c78b3594e4c6-config\" (UniqueName: \"kubernetes.io/configmap/27d35261-c163-4f27-8761-c78b3594e4c6-config\") pod \"27d35261-c163-4f27-8761-c78b3594e4c6\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") "
Oct 30 21:26:13.623412 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.623400    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/27d35261-c163-4f27-8761-c78b3594e4c6-kube-api-access-g7gl9\" (UniqueName: \"kubernetes.io/projected/27d35261-c163-4f27-8761-c78b3594e4c6-kube-api-access-g7gl9\") pod \"27d35261-c163-4f27-8761-c78b3594e4c6\" (UID: \"27d35261-c163-4f27-8761-c78b3594e4c6\") "
Oct 30 21:26:13.623704 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.623682    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27d35261-c163-4f27-8761-c78b3594e4c6-config" pod "27d35261-c163-4f27-8761-c78b3594e4c6" (UID: "27d35261-c163-4f27-8761-c78b3594e4c6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:26:13.625585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.625560    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d35261-c163-4f27-8761-c78b3594e4c6-kube-api-access-g7gl9" pod "27d35261-c163-4f27-8761-c78b3594e4c6" (UID: "27d35261-c163-4f27-8761-c78b3594e4c6"). InnerVolumeSpecName "kube-api-access-g7gl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:26:13.626310 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.626289    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "27d35261-c163-4f27-8761-c78b3594e4c6" (UID: "27d35261-c163-4f27-8761-c78b3594e4c6"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:26:13.724937 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.724900    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:26:13.724937 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.724926    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27d35261-c163-4f27-8761-c78b3594e4c6-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:13.724937 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.724936    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7gl9\" (UniqueName: \"kubernetes.io/projected/27d35261-c163-4f27-8761-c78b3594e4c6-kube-api-access-g7gl9\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:13.736774 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.736756    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:26:13.774441 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.774414    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27d35261-c163-4f27-8761-c78b3594e4c6-plugins" pod "27d35261-c163-4f27-8761-c78b3594e4c6" (UID: "27d35261-c163-4f27-8761-c78b3594e4c6"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:26:13.826271 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.826243    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/27d35261-c163-4f27-8761-c78b3594e4c6-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:13.826366 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.826271    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:26:13.998896 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:13.998863    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:26:14.001667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:14.001640    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:26:15.160354 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:15.160322    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="27d35261-c163-4f27-8761-c78b3594e4c6" path="/var/lib/kubelet/pods/27d35261-c163-4f27-8761-c78b3594e4c6/volumes"
Oct 30 21:26:15.671841 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:26:15.671809    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:26:29.175000 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.174965    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"]
Oct 30 21:26:29.175513 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.175492    5937 cpu_manager.go:414] "containerMap: removing container" podUID="27d35261-c163-4f27-8761-c78b3594e4c6" containerName="perses"
Oct 30 21:26:29.175630 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.175519    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="27d35261-c163-4f27-8761-c78b3594e4c6" containerName="perses"
Oct 30 21:26:29.175960 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.175939    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="27d35261-c163-4f27-8761-c78b3594e4c6" containerName="perses"
Oct 30 21:26:29.197655 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.197627    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"
Oct 30 21:26:29.234172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.234133    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"]
Oct 30 21:26:29.245769 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.245742    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-464tc\" (UniqueName: \"kubernetes.io/projected/b924c1a3-0f54-4c36-86b7-6873ca02d99d-kube-api-access-464tc\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk\" (UID: \"b924c1a3-0f54-4c36-86b7-6873ca02d99d\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"
Oct 30 21:26:29.284163 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.284125    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:26:29.284276 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.284169    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:26:29.301688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.301671    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:26:29.346636 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.346605    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-464tc\" (UniqueName: \"kubernetes.io/projected/b924c1a3-0f54-4c36-86b7-6873ca02d99d-kube-api-access-464tc\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk\" (UID: \"b924c1a3-0f54-4c36-86b7-6873ca02d99d\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"
Oct 30 21:26:29.408973 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.408941    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-464tc\" (UniqueName: \"kubernetes.io/projected/b924c1a3-0f54-4c36-86b7-6873ca02d99d-kube-api-access-464tc\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk\" (UID: \"b924c1a3-0f54-4c36-86b7-6873ca02d99d\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"
Oct 30 21:26:29.508970 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.508939    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"
Oct 30 21:26:29.880081 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:29.880014    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"]
Oct 30 21:26:29.882999 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:26:29.882967    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb924c1a3_0f54_4c36_86b7_6873ca02d99d.slice/crio-01a47f8c009254ed82e8e74bd054f814f866793358578e2f9d2910218837edc3 WatchSource:0}: Error finding container 01a47f8c009254ed82e8e74bd054f814f866793358578e2f9d2910218837edc3: Status 404 returned error can't find the container with id 01a47f8c009254ed82e8e74bd054f814f866793358578e2f9d2910218837edc3
Oct 30 21:26:30.654687 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:30.654645    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk" event={"ID":"b924c1a3-0f54-4c36-86b7-6873ca02d99d","Type":"ContainerStarted","Data":"26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe"}
Oct 30 21:26:30.655061 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:30.654690    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk" event={"ID":"b924c1a3-0f54-4c36-86b7-6873ca02d99d","Type":"ContainerStarted","Data":"01a47f8c009254ed82e8e74bd054f814f866793358578e2f9d2910218837edc3"}
Oct 30 21:26:30.771440 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:30.771392    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk" podStartSLOduration=1.7713767 podStartE2EDuration="1.7713767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:30.770820209 +0000 UTC m=+2965.726834999" watchObservedRunningTime="2026-10-30 21:26:30.7713767 +0000 UTC m=+2965.727391473"
Oct 30 21:26:32.352257 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.352223    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:26:32.355727 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.355703    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.422054 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.422024    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:26:32.459817 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.459745    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:26:32.460175 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.460152    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:26:32.460307 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.460287    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:26:32.471726 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.471703    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:26:32.471929 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.471782    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:26:32.471929 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.471802    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:26:32.472374 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.472357    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:26:32.474151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.474134    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e4dda3b-6820-4bf7-9852-e352f634bee7-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.474200 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.474165    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.474200 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.474182    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw6gx\" (UniqueName: \"kubernetes.io/projected/2e4dda3b-6820-4bf7-9852-e352f634bee7-kube-api-access-qw6gx\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.474281 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.474267    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.474347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.474335    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.474384 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.474353    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.475679 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.475666    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.538112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.538089    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:26:32.554572 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.554526    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:26:32.574869 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.574833    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.574961 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.574893    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.575023 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.575002    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.575088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.575072    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e4dda3b-6820-4bf7-9852-e352f634bee7-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.575145 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.575107    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.575145 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.575123    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw6gx\" (UniqueName: \"kubernetes.io/projected/2e4dda3b-6820-4bf7-9852-e352f634bee7-kube-api-access-qw6gx\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.575773 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.575753    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e4dda3b-6820-4bf7-9852-e352f634bee7-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.577561 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.577515    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.577717 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.577698    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.577934 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.577917    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.578013 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.577992    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.642658 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.642595    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw6gx\" (UniqueName: \"kubernetes.io/projected/2e4dda3b-6820-4bf7-9852-e352f634bee7-kube-api-access-qw6gx\") pod \"data-science-collector-collector-1\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.670022 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.669993    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:26:32.676094 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.676070    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/384f1893-2fd0-4372-98d8-95e983787427-config\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.676196 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.676107    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/384f1893-2fd0-4372-98d8-95e983787427-plugins\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.676242 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.676223    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5222s\" (UniqueName: \"kubernetes.io/projected/384f1893-2fd0-4372-98d8-95e983787427-kube-api-access-5222s\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.698948 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.698918    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"]
Oct 30 21:26:32.702735 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.702716    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:32.776849 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.776816    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6nkf\" (UniqueName: \"kubernetes.io/projected/c2052000-9c75-49ec-852f-dfe23b48a94c-kube-api-access-t6nkf\") pod \"data-science-collector-targetallocator-7c868594f7-mskxf\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:32.776982 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.776879    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5222s\" (UniqueName: \"kubernetes.io/projected/384f1893-2fd0-4372-98d8-95e983787427-kube-api-access-5222s\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.776982 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.776949    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c2052000-9c75-49ec-852f-dfe23b48a94c-ta-internal\") pod \"data-science-collector-targetallocator-7c868594f7-mskxf\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:32.777097 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.776992    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/384f1893-2fd0-4372-98d8-95e983787427-config\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.777097 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.777084    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/384f1893-2fd0-4372-98d8-95e983787427-plugins\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.777205 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.777132    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c2052000-9c75-49ec-852f-dfe23b48a94c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c868594f7-mskxf\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:32.777433 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.777416    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/384f1893-2fd0-4372-98d8-95e983787427-plugins\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.777600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.777585    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/384f1893-2fd0-4372-98d8-95e983787427-config\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.784672 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.784652    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:26:32.785791 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.785757    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:26:32.785911 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.785795    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-shs7s\""
Oct 30 21:26:32.786313 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.786295    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"]
Oct 30 21:26:32.862009 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.861980    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5222s\" (UniqueName: \"kubernetes.io/projected/384f1893-2fd0-4372-98d8-95e983787427-kube-api-access-5222s\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:32.878094 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.878073    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6nkf\" (UniqueName: \"kubernetes.io/projected/c2052000-9c75-49ec-852f-dfe23b48a94c-kube-api-access-t6nkf\") pod \"data-science-collector-targetallocator-7c868594f7-mskxf\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:32.878192 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.878120    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c2052000-9c75-49ec-852f-dfe23b48a94c-ta-internal\") pod \"data-science-collector-targetallocator-7c868594f7-mskxf\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:32.878192 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.878164    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c2052000-9c75-49ec-852f-dfe23b48a94c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c868594f7-mskxf\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:32.878717 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.878698    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c2052000-9c75-49ec-852f-dfe23b48a94c-ta-internal\") pod \"data-science-collector-targetallocator-7c868594f7-mskxf\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:32.880437 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.880421    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c2052000-9c75-49ec-852f-dfe23b48a94c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7c868594f7-mskxf\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:32.948045 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:32.947989    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6nkf\" (UniqueName: \"kubernetes.io/projected/c2052000-9c75-49ec-852f-dfe23b48a94c-kube-api-access-t6nkf\") pod \"data-science-collector-targetallocator-7c868594f7-mskxf\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:33.018380 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.018356    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:33.099680 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.099526    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:26:33.102876 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:26:33.102846    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4dda3b_6820_4bf7_9852_e352f634bee7.slice/crio-8a1ded0f8737084f33cf41f8ed95bbb775e542440e20cc0139928a354e9cfe25 WatchSource:0}: Error finding container 8a1ded0f8737084f33cf41f8ed95bbb775e542440e20cc0139928a354e9cfe25: Status 404 returned error can't find the container with id 8a1ded0f8737084f33cf41f8ed95bbb775e542440e20cc0139928a354e9cfe25
Oct 30 21:26:33.105261 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.105230    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:33.105337 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.105290    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:33.392165 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.392143    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"]
Oct 30 21:26:33.394741 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:26:33.394715    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2052000_9c75_49ec_852f_dfe23b48a94c.slice/crio-3328913e18ce281b553ea0bc67f4ca6ff9eb2f075121bab36c0afa492a7404ef WatchSource:0}: Error finding container 3328913e18ce281b553ea0bc67f4ca6ff9eb2f075121bab36c0afa492a7404ef: Status 404 returned error can't find the container with id 3328913e18ce281b553ea0bc67f4ca6ff9eb2f075121bab36c0afa492a7404ef
Oct 30 21:26:33.396797 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.396770    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:33.396869 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.396820    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:26:33.669011 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.668912    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"2e4dda3b-6820-4bf7-9852-e352f634bee7","Type":"ContainerStarted","Data":"525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f"}
Oct 30 21:26:33.669011 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.668978    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"2e4dda3b-6820-4bf7-9852-e352f634bee7","Type":"ContainerStarted","Data":"8a1ded0f8737084f33cf41f8ed95bbb775e542440e20cc0139928a354e9cfe25"}
Oct 30 21:26:33.670440 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.670417    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf" event={"ID":"c2052000-9c75-49ec-852f-dfe23b48a94c","Type":"ContainerStarted","Data":"cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24"}
Oct 30 21:26:33.670440 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.670443    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf" event={"ID":"c2052000-9c75-49ec-852f-dfe23b48a94c","Type":"ContainerStarted","Data":"3328913e18ce281b553ea0bc67f4ca6ff9eb2f075121bab36c0afa492a7404ef"}
Oct 30 21:26:33.670649 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.670607    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:33.671568 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.671511    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf" podUID="c2052000-9c75-49ec-852f-dfe23b48a94c" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.112:8080/readyz\": dial tcp 10.134.0.112:8080: connect: connection refused"
Oct 30 21:26:33.789627 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.789577    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.789562422 podStartE2EDuration="1.789562422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:33.788803415 +0000 UTC m=+2968.744818193" watchObservedRunningTime="2026-10-30 21:26:33.789562422 +0000 UTC m=+2968.745577191"
Oct 30 21:26:33.926712 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:33.926614    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf" podStartSLOduration=1.92659431 podStartE2EDuration="1.92659431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:33.926020368 +0000 UTC m=+2968.882035146" watchObservedRunningTime="2026-10-30 21:26:33.92659431 +0000 UTC m=+2968.882609087"
Oct 30 21:26:34.676683 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:34.676654    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:26:37.421186 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:37.421103    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:37.527043 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:37.527013    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:37.622945 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:37.622917    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:37.623100 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:37.623051    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:37.676347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:37.676289    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:37.817738 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:37.817711    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:37.886311 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:37.886286    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:38.187613 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:38.187583    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:38.559948 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:38.559842    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:26:38.562837 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:26:38.562808    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod384f1893_2fd0_4372_98d8_95e983787427.slice/crio-65c8880e354ab1745fc0989ac5df7c551754a235c356c196c67678e6862402b4 WatchSource:0}: Error finding container 65c8880e354ab1745fc0989ac5df7c551754a235c356c196c67678e6862402b4: Status 404 returned error can't find the container with id 65c8880e354ab1745fc0989ac5df7c551754a235c356c196c67678e6862402b4
Oct 30 21:26:38.694738 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:38.694700    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"384f1893-2fd0-4372-98d8-95e983787427","Type":"ContainerStarted","Data":"5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d"}
Oct 30 21:26:38.694902 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:38.694752    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"384f1893-2fd0-4372-98d8-95e983787427","Type":"ContainerStarted","Data":"65c8880e354ab1745fc0989ac5df7c551754a235c356c196c67678e6862402b4"}
Oct 30 21:26:38.694902 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:38.694775    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:26:38.814668 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:38.814531    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=6.81451022 podStartE2EDuration="6.81451022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:38.813518416 +0000 UTC m=+2973.769533207" watchObservedRunningTime="2026-10-30 21:26:38.81451022 +0000 UTC m=+2973.770525001"
Oct 30 21:26:44.473294 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:44.473189    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"]
Oct 30 21:26:44.494249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:44.494222    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"
Oct 30 21:26:44.532598 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:44.532572    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"]
Oct 30 21:26:44.583073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:44.583043    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcmgw\" (UniqueName: \"kubernetes.io/projected/b25887a3-559c-44e6-897e-072ed1cc1d60-kube-api-access-rcmgw\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf\" (UID: \"b25887a3-559c-44e6-897e-072ed1cc1d60\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"
Oct 30 21:26:44.683942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:44.683910    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcmgw\" (UniqueName: \"kubernetes.io/projected/b25887a3-559c-44e6-897e-072ed1cc1d60-kube-api-access-rcmgw\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf\" (UID: \"b25887a3-559c-44e6-897e-072ed1cc1d60\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"
Oct 30 21:26:44.745996 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:44.745932    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcmgw\" (UniqueName: \"kubernetes.io/projected/b25887a3-559c-44e6-897e-072ed1cc1d60-kube-api-access-rcmgw\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf\" (UID: \"b25887a3-559c-44e6-897e-072ed1cc1d60\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"
Oct 30 21:26:44.805938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:44.805907    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"
Oct 30 21:26:45.174650 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:45.174585    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"]
Oct 30 21:26:45.177648 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:26:45.177617    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb25887a3_559c_44e6_897e_072ed1cc1d60.slice/crio-c0118d8bd79c183f9a177677dcb8c437a4e63707eaee21469029655dcec267ca WatchSource:0}: Error finding container c0118d8bd79c183f9a177677dcb8c437a4e63707eaee21469029655dcec267ca: Status 404 returned error can't find the container with id c0118d8bd79c183f9a177677dcb8c437a4e63707eaee21469029655dcec267ca
Oct 30 21:26:45.671569 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:26:45.671504    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:26:45.727340 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:45.727308    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf" event={"ID":"b25887a3-559c-44e6-897e-072ed1cc1d60","Type":"ContainerStarted","Data":"9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df"}
Oct 30 21:26:45.727340 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:45.727344    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf" event={"ID":"b25887a3-559c-44e6-897e-072ed1cc1d60","Type":"ContainerStarted","Data":"c0118d8bd79c183f9a177677dcb8c437a4e63707eaee21469029655dcec267ca"}
Oct 30 21:26:45.845427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:45.845378    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf" podStartSLOduration=1.8453652539999998 podStartE2EDuration="1.845365254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:26:45.844597747 +0000 UTC m=+2980.800612525" watchObservedRunningTime="2026-10-30 21:26:45.845365254 +0000 UTC m=+2980.801380030"
Oct 30 21:26:45.879972 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:45.879945    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"]
Oct 30 21:26:45.880129 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:45.880109    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk" podUID="b924c1a3-0f54-4c36-86b7-6873ca02d99d" containerName="thanos-querier" containerID="cri-o://26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe" gracePeriod=30
Oct 30 21:26:46.121466 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.121441    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"
Oct 30 21:26:46.199032 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.199004    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b924c1a3-0f54-4c36-86b7-6873ca02d99d-kube-api-access-464tc\" (UniqueName: \"kubernetes.io/projected/b924c1a3-0f54-4c36-86b7-6873ca02d99d-kube-api-access-464tc\") pod \"b924c1a3-0f54-4c36-86b7-6873ca02d99d\" (UID: \"b924c1a3-0f54-4c36-86b7-6873ca02d99d\") "
Oct 30 21:26:46.201619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.201585    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b924c1a3-0f54-4c36-86b7-6873ca02d99d-kube-api-access-464tc" pod "b924c1a3-0f54-4c36-86b7-6873ca02d99d" (UID: "b924c1a3-0f54-4c36-86b7-6873ca02d99d"). InnerVolumeSpecName "kube-api-access-464tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:26:46.299690 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.299609    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-464tc\" (UniqueName: \"kubernetes.io/projected/b924c1a3-0f54-4c36-86b7-6873ca02d99d-kube-api-access-464tc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:26:46.733019 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.732986    5937 generic.go:356] "Generic (PLEG): container finished" podID="b924c1a3-0f54-4c36-86b7-6873ca02d99d" containerID="26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe" exitCode=0
Oct 30 21:26:46.733470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.733032    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"
Oct 30 21:26:46.733470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.733069    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk" event={"ID":"b924c1a3-0f54-4c36-86b7-6873ca02d99d","Type":"ContainerDied","Data":"26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe"}
Oct 30 21:26:46.733470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.733104    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk" event={"ID":"b924c1a3-0f54-4c36-86b7-6873ca02d99d","Type":"ContainerDied","Data":"01a47f8c009254ed82e8e74bd054f814f866793358578e2f9d2910218837edc3"}
Oct 30 21:26:46.733470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.733123    5937 scope.go:122] "RemoveContainer" containerID="26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe"
Oct 30 21:26:46.741991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.741973    5937 scope.go:122] "RemoveContainer" containerID="26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe"
Oct 30 21:26:46.742261 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:26:46.742242    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe\": container with ID starting with 26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe not found: ID does not exist" containerID="26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe"
Oct 30 21:26:46.742312 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.742268    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe"} err="failed to get container status \"26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe\": rpc error: code = NotFound desc = could not find container \"26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe\": container with ID starting with 26b5996abcd4174a48daa3b65ffabefdef3b48a760b097cf9ef53174c284adbe not found: ID does not exist"
Oct 30 21:26:46.899717 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.899691    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"]
Oct 30 21:26:46.903398 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:46.903371    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-gwxnk"]
Oct 30 21:26:47.161720 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:47.161638    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b924c1a3-0f54-4c36-86b7-6873ca02d99d" path="/var/lib/kubelet/pods/b924c1a3-0f54-4c36-86b7-6873ca02d99d/volumes"
Oct 30 21:26:49.701153 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:26:49.701116    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:27:15.670754 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:27:15.670710    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:27:30.560027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:30.559996    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:27:30.560431 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:30.560190    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="2e4dda3b-6820-4bf7-9852-e352f634bee7" containerName="otc-container" containerID="cri-o://525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f" gracePeriod=30
Oct 30 21:27:31.224790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.224752    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"]
Oct 30 21:27:31.225176 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.225163    5937 cpu_manager.go:414] "containerMap: removing container" podUID="b924c1a3-0f54-4c36-86b7-6873ca02d99d" containerName="thanos-querier"
Oct 30 21:27:31.225219 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.225177    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b924c1a3-0f54-4c36-86b7-6873ca02d99d" containerName="thanos-querier"
Oct 30 21:27:31.225254 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.225238    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="b924c1a3-0f54-4c36-86b7-6873ca02d99d" containerName="thanos-querier"
Oct 30 21:27:31.229146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.229129    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.287978 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.287948    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"]
Oct 30 21:27:31.372901 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.372871    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddmrc\" (UniqueName: \"kubernetes.io/projected/d7d38bee-dc06-473b-a794-792b79189050-kube-api-access-ddmrc\") pod \"data-science-collector-targetallocator-77b4c4c5c8-5xbmp\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.373044 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.372954    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7d38bee-dc06-473b-a794-792b79189050-ta-internal\") pod \"data-science-collector-targetallocator-77b4c4c5c8-5xbmp\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.373044 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.373017    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7d38bee-dc06-473b-a794-792b79189050-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77b4c4c5c8-5xbmp\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.474146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.474118    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7d38bee-dc06-473b-a794-792b79189050-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77b4c4c5c8-5xbmp\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.474265 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.474168    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmrc\" (UniqueName: \"kubernetes.io/projected/d7d38bee-dc06-473b-a794-792b79189050-kube-api-access-ddmrc\") pod \"data-science-collector-targetallocator-77b4c4c5c8-5xbmp\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.474265 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.474226    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7d38bee-dc06-473b-a794-792b79189050-ta-internal\") pod \"data-science-collector-targetallocator-77b4c4c5c8-5xbmp\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.474934 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.474889    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7d38bee-dc06-473b-a794-792b79189050-ta-internal\") pod \"data-science-collector-targetallocator-77b4c4c5c8-5xbmp\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.476816 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.476794    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7d38bee-dc06-473b-a794-792b79189050-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-77b4c4c5c8-5xbmp\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.536132 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.536107    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddmrc\" (UniqueName: \"kubernetes.io/projected/d7d38bee-dc06-473b-a794-792b79189050-kube-api-access-ddmrc\") pod \"data-science-collector-targetallocator-77b4c4c5c8-5xbmp\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.540013 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.539980    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:31.909840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.909771    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"]
Oct 30 21:27:31.912052 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:27:31.912027    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7d38bee_dc06_473b_a794_792b79189050.slice/crio-36c6c6e54dfb83c25877125dbabf0434f120e9b09f2dd18ccc13f36d89af1bed WatchSource:0}: Error finding container 36c6c6e54dfb83c25877125dbabf0434f120e9b09f2dd18ccc13f36d89af1bed: Status 404 returned error can't find the container with id 36c6c6e54dfb83c25877125dbabf0434f120e9b09f2dd18ccc13f36d89af1bed
Oct 30 21:27:31.914224 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.914195    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:27:31.914298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.914247    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:27:31.932621 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:31.932598    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp" event={"ID":"d7d38bee-dc06-473b-a794-792b79189050","Type":"ContainerStarted","Data":"36c6c6e54dfb83c25877125dbabf0434f120e9b09f2dd18ccc13f36d89af1bed"}
Oct 30 21:27:32.902859 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.902835    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:27:32.939132 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.939102    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp" event={"ID":"d7d38bee-dc06-473b-a794-792b79189050","Type":"ContainerStarted","Data":"0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d"}
Oct 30 21:27:32.939522 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.939233    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:32.940154 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.940131    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp" podUID="d7d38bee-dc06-473b-a794-792b79189050" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.114:8080/readyz\": dial tcp 10.134.0.114:8080: connect: connection refused"
Oct 30 21:27:32.940773 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.940752    5937 generic.go:356] "Generic (PLEG): container finished" podID="2e4dda3b-6820-4bf7-9852-e352f634bee7" containerID="525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f" exitCode=0
Oct 30 21:27:32.940878 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.940794    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"2e4dda3b-6820-4bf7-9852-e352f634bee7","Type":"ContainerDied","Data":"525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f"}
Oct 30 21:27:32.940878 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.940801    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:27:32.940878 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.940854    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"2e4dda3b-6820-4bf7-9852-e352f634bee7","Type":"ContainerDied","Data":"8a1ded0f8737084f33cf41f8ed95bbb775e542440e20cc0139928a354e9cfe25"}
Oct 30 21:27:32.940878 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.940877    5937 scope.go:122] "RemoveContainer" containerID="525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f"
Oct 30 21:27:32.949298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.949281    5937 scope.go:122] "RemoveContainer" containerID="525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f"
Oct 30 21:27:32.949585 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:27:32.949566    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f\": container with ID starting with 525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f not found: ID does not exist" containerID="525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f"
Oct 30 21:27:32.949648 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.949593    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f"} err="failed to get container status \"525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f\": rpc error: code = NotFound desc = could not find container \"525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f\": container with ID starting with 525610f2152e570af6e9909ddac58d7521bfadcdbbf54a65e1a752a2d227c33f not found: ID does not exist"
Oct 30 21:27:32.986675 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.986657    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e4dda3b-6820-4bf7-9852-e352f634bee7-kube-api-access-qw6gx\" (UniqueName: \"kubernetes.io/projected/2e4dda3b-6820-4bf7-9852-e352f634bee7-kube-api-access-qw6gx\") pod \"2e4dda3b-6820-4bf7-9852-e352f634bee7\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") "
Oct 30 21:27:32.986801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.986709    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e4dda3b-6820-4bf7-9852-e352f634bee7-otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e4dda3b-6820-4bf7-9852-e352f634bee7-otc-internal\") pod \"2e4dda3b-6820-4bf7-9852-e352f634bee7\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") "
Oct 30 21:27:32.986801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.986727    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-monitoring-tls-certs\") pod \"2e4dda3b-6820-4bf7-9852-e352f634bee7\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") "
Oct 30 21:27:32.986801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.986745    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-data-science-collector-ta-client-cert\") pod \"2e4dda3b-6820-4bf7-9852-e352f634bee7\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") "
Oct 30 21:27:32.986986 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.986803    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-tls-certs\") pod \"2e4dda3b-6820-4bf7-9852-e352f634bee7\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") "
Oct 30 21:27:32.986986 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.986856    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-otlp-tls-certs\") pod \"2e4dda3b-6820-4bf7-9852-e352f634bee7\" (UID: \"2e4dda3b-6820-4bf7-9852-e352f634bee7\") "
Oct 30 21:27:32.987118 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.987092    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e4dda3b-6820-4bf7-9852-e352f634bee7-otc-internal" pod "2e4dda3b-6820-4bf7-9852-e352f634bee7" (UID: "2e4dda3b-6820-4bf7-9852-e352f634bee7"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:27:32.989074 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.989045    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-data-science-collector-ta-client-cert" pod "2e4dda3b-6820-4bf7-9852-e352f634bee7" (UID: "2e4dda3b-6820-4bf7-9852-e352f634bee7"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:32.989167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.989092    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-tls-certs" pod "2e4dda3b-6820-4bf7-9852-e352f634bee7" (UID: "2e4dda3b-6820-4bf7-9852-e352f634bee7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:32.989167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.989107    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-monitoring-tls-certs" pod "2e4dda3b-6820-4bf7-9852-e352f634bee7" (UID: "2e4dda3b-6820-4bf7-9852-e352f634bee7"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:32.989467 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.989447    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-otlp-tls-certs" pod "2e4dda3b-6820-4bf7-9852-e352f634bee7" (UID: "2e4dda3b-6820-4bf7-9852-e352f634bee7"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:32.989529 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:32.989476    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e4dda3b-6820-4bf7-9852-e352f634bee7-kube-api-access-qw6gx" pod "2e4dda3b-6820-4bf7-9852-e352f634bee7" (UID: "2e4dda3b-6820-4bf7-9852-e352f634bee7"). InnerVolumeSpecName "kube-api-access-qw6gx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:33.088168 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.088133    5937 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-otlp-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:33.088168 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.088165    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw6gx\" (UniqueName: \"kubernetes.io/projected/2e4dda3b-6820-4bf7-9852-e352f634bee7-kube-api-access-qw6gx\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:33.088360 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.088183    5937 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/2e4dda3b-6820-4bf7-9852-e352f634bee7-otc-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:33.088360 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.088196    5937 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-monitoring-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:33.088360 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.088211    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-data-science-collector-ta-client-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:33.088360 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.088225    5937 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e4dda3b-6820-4bf7-9852-e352f634bee7-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:33.196349 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.196300    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp" podStartSLOduration=2.196287096 podStartE2EDuration="2.196287096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:33.195395088 +0000 UTC m=+3028.151409867" watchObservedRunningTime="2026-10-30 21:27:33.196287096 +0000 UTC m=+3028.152301865"
Oct 30 21:27:33.356564 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.356472    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:27:33.360624 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.360599    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:27:33.947622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:33.947596    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:27:34.099174 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.099148    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"]
Oct 30 21:27:34.099399 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.099333    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf" podUID="c2052000-9c75-49ec-852f-dfe23b48a94c" containerName="ta-container" containerID="cri-o://cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24" gracePeriod=30
Oct 30 21:27:34.348084 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.348056    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:27:34.500030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.499946    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c2052000-9c75-49ec-852f-dfe23b48a94c-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c2052000-9c75-49ec-852f-dfe23b48a94c-data-science-collector-ta-server-cert\") pod \"c2052000-9c75-49ec-852f-dfe23b48a94c\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") "
Oct 30 21:27:34.500030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.499993    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2052000-9c75-49ec-852f-dfe23b48a94c-kube-api-access-t6nkf\" (UniqueName: \"kubernetes.io/projected/c2052000-9c75-49ec-852f-dfe23b48a94c-kube-api-access-t6nkf\") pod \"c2052000-9c75-49ec-852f-dfe23b48a94c\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") "
Oct 30 21:27:34.500030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.500021    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c2052000-9c75-49ec-852f-dfe23b48a94c-ta-internal\" (UniqueName: \"kubernetes.io/configmap/c2052000-9c75-49ec-852f-dfe23b48a94c-ta-internal\") pod \"c2052000-9c75-49ec-852f-dfe23b48a94c\" (UID: \"c2052000-9c75-49ec-852f-dfe23b48a94c\") "
Oct 30 21:27:34.500351 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.500327    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2052000-9c75-49ec-852f-dfe23b48a94c-ta-internal" pod "c2052000-9c75-49ec-852f-dfe23b48a94c" (UID: "c2052000-9c75-49ec-852f-dfe23b48a94c"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:27:34.502216 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.502193    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2052000-9c75-49ec-852f-dfe23b48a94c-kube-api-access-t6nkf" pod "c2052000-9c75-49ec-852f-dfe23b48a94c" (UID: "c2052000-9c75-49ec-852f-dfe23b48a94c"). InnerVolumeSpecName "kube-api-access-t6nkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:34.502308 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.502240    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2052000-9c75-49ec-852f-dfe23b48a94c-data-science-collector-ta-server-cert" pod "c2052000-9c75-49ec-852f-dfe23b48a94c" (UID: "c2052000-9c75-49ec-852f-dfe23b48a94c"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:34.601001 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.600972    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/c2052000-9c75-49ec-852f-dfe23b48a94c-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:34.601001 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.601000    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6nkf\" (UniqueName: \"kubernetes.io/projected/c2052000-9c75-49ec-852f-dfe23b48a94c-kube-api-access-t6nkf\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:34.601159 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.601016    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/c2052000-9c75-49ec-852f-dfe23b48a94c-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:34.779844 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.779782    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df"]
Oct 30 21:27:34.780191 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.780174    5937 cpu_manager.go:414] "containerMap: removing container" podUID="c2052000-9c75-49ec-852f-dfe23b48a94c" containerName="ta-container"
Oct 30 21:27:34.780269 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.780194    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2052000-9c75-49ec-852f-dfe23b48a94c" containerName="ta-container"
Oct 30 21:27:34.780269 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.780221    5937 cpu_manager.go:414] "containerMap: removing container" podUID="2e4dda3b-6820-4bf7-9852-e352f634bee7" containerName="otc-container"
Oct 30 21:27:34.780269 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.780231    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e4dda3b-6820-4bf7-9852-e352f634bee7" containerName="otc-container"
Oct 30 21:27:34.780427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.780325    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e4dda3b-6820-4bf7-9852-e352f634bee7" containerName="otc-container"
Oct 30 21:27:34.780427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.780344    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2052000-9c75-49ec-852f-dfe23b48a94c" containerName="ta-container"
Oct 30 21:27:34.783348 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.783330    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df"
Oct 30 21:27:34.794157 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.794141    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df"
Oct 30 21:27:34.839439 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.839257    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df"]
Oct 30 21:27:34.952188 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.952154    5937 generic.go:356] "Generic (PLEG): container finished" podID="c2052000-9c75-49ec-852f-dfe23b48a94c" containerID="cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24" exitCode=0
Oct 30 21:27:34.952622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.952194    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"
Oct 30 21:27:34.952622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.952245    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf" event={"ID":"c2052000-9c75-49ec-852f-dfe23b48a94c","Type":"ContainerDied","Data":"cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24"}
Oct 30 21:27:34.952622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.952281    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf" event={"ID":"c2052000-9c75-49ec-852f-dfe23b48a94c","Type":"ContainerDied","Data":"3328913e18ce281b553ea0bc67f4ca6ff9eb2f075121bab36c0afa492a7404ef"}
Oct 30 21:27:34.952622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.952302    5937 scope.go:122] "RemoveContainer" containerID="cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24"
Oct 30 21:27:34.960988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.960967    5937 scope.go:122] "RemoveContainer" containerID="cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24"
Oct 30 21:27:34.961265 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:27:34.961246    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24\": container with ID starting with cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24 not found: ID does not exist" containerID="cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24"
Oct 30 21:27:34.961317 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:34.961274    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24"} err="failed to get container status \"cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24\": rpc error: code = NotFound desc = could not find container \"cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24\": container with ID starting with cd8c871a5ddd32c00ae27adbc32e4508dfd4d1f9cdabe4afaa8bae5cc27f1f24 not found: ID does not exist"
Oct 30 21:27:35.119530 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:35.119451    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"]
Oct 30 21:27:35.123344 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:35.123323    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7c868594f7-mskxf"]
Oct 30 21:27:35.160661 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:35.160628    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e4dda3b-6820-4bf7-9852-e352f634bee7" path="/var/lib/kubelet/pods/2e4dda3b-6820-4bf7-9852-e352f634bee7/volumes"
Oct 30 21:27:35.161205 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:35.161185    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2052000-9c75-49ec-852f-dfe23b48a94c" path="/var/lib/kubelet/pods/c2052000-9c75-49ec-852f-dfe23b48a94c/volumes"
Oct 30 21:27:35.170124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:35.170104    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df"]
Oct 30 21:27:35.171620 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:27:35.171597    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadcfad59_4a9e_4e5c_8c46_164670509b30.slice/crio-def9efbc1cdf354f3c1cf4ad4bb99ff02657380a56eb19ac9ef9046685aef0f4 WatchSource:0}: Error finding container def9efbc1cdf354f3c1cf4ad4bb99ff02657380a56eb19ac9ef9046685aef0f4: Status 404 returned error can't find the container with id def9efbc1cdf354f3c1cf4ad4bb99ff02657380a56eb19ac9ef9046685aef0f4
Oct 30 21:27:35.958416 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:35.958383    5937 generic.go:356] "Generic (PLEG): container finished" podID="adcfad59-4a9e-4e5c-8c46-164670509b30" containerID="13f254107d08e006345a977fa127d7290bfa7e217e773fe54421b34589b5dfb6" exitCode=0
Oct 30 21:27:35.958809 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:35.958466    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df" event={"ID":"adcfad59-4a9e-4e5c-8c46-164670509b30","Type":"ContainerDied","Data":"13f254107d08e006345a977fa127d7290bfa7e217e773fe54421b34589b5dfb6"}
Oct 30 21:27:35.958809 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:35.958502    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df" event={"ID":"adcfad59-4a9e-4e5c-8c46-164670509b30","Type":"ContainerStarted","Data":"def9efbc1cdf354f3c1cf4ad4bb99ff02657380a56eb19ac9ef9046685aef0f4"}
Oct 30 21:27:37.091313 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:37.091287    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df"
Oct 30 21:27:37.968969 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:37.968931    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df" event={"ID":"adcfad59-4a9e-4e5c-8c46-164670509b30","Type":"ContainerDied","Data":"def9efbc1cdf354f3c1cf4ad4bb99ff02657380a56eb19ac9ef9046685aef0f4"}
Oct 30 21:27:37.969172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:37.968978    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="def9efbc1cdf354f3c1cf4ad4bb99ff02657380a56eb19ac9ef9046685aef0f4"
Oct 30 21:27:37.969172 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:37.968937    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df"
Oct 30 21:27:38.843502 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:38.843474    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df"]
Oct 30 21:27:38.851633 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:38.851608    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-prometheus-18e36bd89a5358df"]
Oct 30 21:27:38.955086 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:38.955055    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"]
Oct 30 21:27:38.955421 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:38.955409    5937 cpu_manager.go:414] "containerMap: removing container" podUID="adcfad59-4a9e-4e5c-8c46-164670509b30" containerName="curl"
Oct 30 21:27:38.955516 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:38.955422    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="adcfad59-4a9e-4e5c-8c46-164670509b30" containerName="curl"
Oct 30 21:27:38.955516 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:38.955476    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="adcfad59-4a9e-4e5c-8c46-164670509b30" containerName="curl"
Oct 30 21:27:38.958356 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:38.958341    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"
Oct 30 21:27:38.969165 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:38.969142    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"
Oct 30 21:27:39.014903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:39.014867    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"]
Oct 30 21:27:39.161343 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:39.161261    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="adcfad59-4a9e-4e5c-8c46-164670509b30" path="/var/lib/kubelet/pods/adcfad59-4a9e-4e5c-8c46-164670509b30/volumes"
Oct 30 21:27:39.343959 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:39.343920    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"]
Oct 30 21:27:39.346960 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:27:39.346931    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7df2077f_1227_4578_81ea_4f5435f4c7a5.slice/crio-62e50c03ae15f9b5f676708aa02d27da9ee64cb69be1f0bcddc44f99b71477ad WatchSource:0}: Error finding container 62e50c03ae15f9b5f676708aa02d27da9ee64cb69be1f0bcddc44f99b71477ad: Status 404 returned error can't find the container with id 62e50c03ae15f9b5f676708aa02d27da9ee64cb69be1f0bcddc44f99b71477ad
Oct 30 21:27:39.979001 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:39.978967    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447" event={"ID":"7df2077f-1227-4578-81ea-4f5435f4c7a5","Type":"ContainerStarted","Data":"fa891fcb4353090a484c058e324b9c3043af7b78bfeb99eab6e88dac6ba487a5"}
Oct 30 21:27:39.979388 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:39.979008    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447" event={"ID":"7df2077f-1227-4578-81ea-4f5435f4c7a5","Type":"ContainerStarted","Data":"62e50c03ae15f9b5f676708aa02d27da9ee64cb69be1f0bcddc44f99b71477ad"}
Oct 30 21:27:40.101909 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:40.101857    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447" podStartSLOduration=2.101842765 podStartE2EDuration="2.101842765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:40.101724493 +0000 UTC m=+3035.057739269" watchObservedRunningTime="2026-10-30 21:27:40.101842765 +0000 UTC m=+3035.057857538"
Oct 30 21:27:45.002605 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:45.002572    5937 generic.go:356] "Generic (PLEG): container finished" podID="7df2077f-1227-4578-81ea-4f5435f4c7a5" containerID="fa891fcb4353090a484c058e324b9c3043af7b78bfeb99eab6e88dac6ba487a5" exitCode=0
Oct 30 21:27:45.002999 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:45.002654    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447" event={"ID":"7df2077f-1227-4578-81ea-4f5435f4c7a5","Type":"ContainerDied","Data":"fa891fcb4353090a484c058e324b9c3043af7b78bfeb99eab6e88dac6ba487a5"}
Oct 30 21:27:45.671645 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:27:45.671610    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:27:46.135044 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:46.135019    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"
Oct 30 21:27:47.013595 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.013571    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"
Oct 30 21:27:47.013842 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.013568    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447" event={"ID":"7df2077f-1227-4578-81ea-4f5435f4c7a5","Type":"ContainerDied","Data":"62e50c03ae15f9b5f676708aa02d27da9ee64cb69be1f0bcddc44f99b71477ad"}
Oct 30 21:27:47.013842 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.013687    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62e50c03ae15f9b5f676708aa02d27da9ee64cb69be1f0bcddc44f99b71477ad"
Oct 30 21:27:47.055475 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.055448    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"]
Oct 30 21:27:47.059233 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.059208    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"]
Oct 30 21:27:47.073163 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:27:47.073134    5937 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-perses-18e36bd9936de447\" is forbidden: User \"system:node:ip-10-0-141-37.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-141-37.us-west-1.compute.internal' and this object" podUID="7df2077f-1227-4578-81ea-4f5435f4c7a5" pod="redhat-ods-monitoring/thanos-ingress-perses-18e36bd9936de447"
Oct 30 21:27:47.161267 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.161232    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7df2077f-1227-4578-81ea-4f5435f4c7a5" path="/var/lib/kubelet/pods/7df2077f-1227-4578-81ea-4f5435f4c7a5/volumes"
Oct 30 21:27:47.167446 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.167421    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af"]
Oct 30 21:27:47.167877 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.167860    5937 cpu_manager.go:414] "containerMap: removing container" podUID="7df2077f-1227-4578-81ea-4f5435f4c7a5" containerName="curl"
Oct 30 21:27:47.167965 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.167879    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7df2077f-1227-4578-81ea-4f5435f4c7a5" containerName="curl"
Oct 30 21:27:47.167965 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.167957    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="7df2077f-1227-4578-81ea-4f5435f4c7a5" containerName="curl"
Oct 30 21:27:47.170943 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.170927    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af"
Oct 30 21:27:47.181530 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.181512    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af"
Oct 30 21:27:47.227873 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.227843    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af"]
Oct 30 21:27:47.555861 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:47.555816    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af"]
Oct 30 21:27:47.558769 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:27:47.558741    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a473cf0_afd7_4438_b11b_d5b86fedd4e0.slice/crio-c346528bf8d8408f1dd7ae75de2cf0dbd2fd059e00fe1542eb9ae23fbe48dbd0 WatchSource:0}: Error finding container c346528bf8d8408f1dd7ae75de2cf0dbd2fd059e00fe1542eb9ae23fbe48dbd0: Status 404 returned error can't find the container with id c346528bf8d8408f1dd7ae75de2cf0dbd2fd059e00fe1542eb9ae23fbe48dbd0
Oct 30 21:27:48.019923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:48.019890    5937 generic.go:356] "Generic (PLEG): container finished" podID="3a473cf0-afd7-4438-b11b-d5b86fedd4e0" containerID="7599cb00b2da5c381dce5166f7a2cab33b77e7e11984c855907958e68b441056" exitCode=0
Oct 30 21:27:48.020087 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:48.019930    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af" event={"ID":"3a473cf0-afd7-4438-b11b-d5b86fedd4e0","Type":"ContainerDied","Data":"7599cb00b2da5c381dce5166f7a2cab33b77e7e11984c855907958e68b441056"}
Oct 30 21:27:48.020087 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:48.019966    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af" event={"ID":"3a473cf0-afd7-4438-b11b-d5b86fedd4e0","Type":"ContainerStarted","Data":"c346528bf8d8408f1dd7ae75de2cf0dbd2fd059e00fe1542eb9ae23fbe48dbd0"}
Oct 30 21:27:49.154845 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:49.154820    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af"
Oct 30 21:27:50.031840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:50.031814    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af"
Oct 30 21:27:50.032010 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:50.031811    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af" event={"ID":"3a473cf0-afd7-4438-b11b-d5b86fedd4e0","Type":"ContainerDied","Data":"c346528bf8d8408f1dd7ae75de2cf0dbd2fd059e00fe1542eb9ae23fbe48dbd0"}
Oct 30 21:27:50.032010 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:50.031934    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c346528bf8d8408f1dd7ae75de2cf0dbd2fd059e00fe1542eb9ae23fbe48dbd0"
Oct 30 21:27:51.230926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.230896    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af"]
Oct 30 21:27:51.237470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.237438    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-korrel8r-18e36bdb7cb116af"]
Oct 30 21:27:51.345341 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.345309    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"]
Oct 30 21:27:51.345714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.345700    5937 cpu_manager.go:414] "containerMap: removing container" podUID="3a473cf0-afd7-4438-b11b-d5b86fedd4e0" containerName="curl"
Oct 30 21:27:51.345765 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.345715    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3a473cf0-afd7-4438-b11b-d5b86fedd4e0" containerName="curl"
Oct 30 21:27:51.345801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.345789    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="3a473cf0-afd7-4438-b11b-d5b86fedd4e0" containerName="curl"
Oct 30 21:27:51.348745 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.348729    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"
Oct 30 21:27:51.359281 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.359259    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"
Oct 30 21:27:51.404879 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.404842    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"]
Oct 30 21:27:51.729403 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:51.729376    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"]
Oct 30 21:27:51.732246 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:27:51.732218    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7746b9d6_9ff0_4def_b301_65b8601b73fe.slice/crio-94e1ad7e0c854779103dedda603d66d1392329a7593f01ef887218de0b5e7ea2 WatchSource:0}: Error finding container 94e1ad7e0c854779103dedda603d66d1392329a7593f01ef887218de0b5e7ea2: Status 404 returned error can't find the container with id 94e1ad7e0c854779103dedda603d66d1392329a7593f01ef887218de0b5e7ea2
Oct 30 21:27:52.041903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:52.041819    5937 generic.go:356] "Generic (PLEG): container finished" podID="7746b9d6-9ff0-4def-b301-65b8601b73fe" containerID="33c1ca844d1ad04b33693eb58d6b07df87cd69d62bf1cb42ae64447fc430115d" exitCode=0
Oct 30 21:27:52.041903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:52.041869    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9" event={"ID":"7746b9d6-9ff0-4def-b301-65b8601b73fe","Type":"ContainerDied","Data":"33c1ca844d1ad04b33693eb58d6b07df87cd69d62bf1cb42ae64447fc430115d"}
Oct 30 21:27:52.041903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:52.041901    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9" event={"ID":"7746b9d6-9ff0-4def-b301-65b8601b73fe","Type":"ContainerStarted","Data":"94e1ad7e0c854779103dedda603d66d1392329a7593f01ef887218de0b5e7ea2"}
Oct 30 21:27:53.161027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.160998    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3a473cf0-afd7-4438-b11b-d5b86fedd4e0" path="/var/lib/kubelet/pods/3a473cf0-afd7-4438-b11b-d5b86fedd4e0/volumes"
Oct 30 21:27:53.167810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.167792    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"
Oct 30 21:27:53.391780 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.391701    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"]
Oct 30 21:27:53.395975 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.395952    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"]
Oct 30 21:27:53.517315 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.517287    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430"]
Oct 30 21:27:53.517667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.517654    5937 cpu_manager.go:414] "containerMap: removing container" podUID="7746b9d6-9ff0-4def-b301-65b8601b73fe" containerName="curl"
Oct 30 21:27:53.517717 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.517669    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7746b9d6-9ff0-4def-b301-65b8601b73fe" containerName="curl"
Oct 30 21:27:53.517752 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.517735    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="7746b9d6-9ff0-4def-b301-65b8601b73fe" containerName="curl"
Oct 30 21:27:53.525196 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.525154    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430"
Oct 30 21:27:53.575916 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.575892    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430"]
Oct 30 21:27:53.579093 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.579070    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"thanos-ingress-probe-18e36bdcf55b9039\"/\"default-dockercfg-8fh94\""
Oct 30 21:27:53.586284 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.586268    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430"
Oct 30 21:27:53.953991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:53.953963    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430"]
Oct 30 21:27:53.956983 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:27:53.956952    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod821f67db_8f20_444b_a4d8_93b699f2e36b.slice/crio-e026c8bb77d9bad094ecbf9c8062460f3e0c901f3710a9d6c7d1aa47bdeea7eb WatchSource:0}: Error finding container e026c8bb77d9bad094ecbf9c8062460f3e0c901f3710a9d6c7d1aa47bdeea7eb: Status 404 returned error can't find the container with id e026c8bb77d9bad094ecbf9c8062460f3e0c901f3710a9d6c7d1aa47bdeea7eb
Oct 30 21:27:54.052802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:54.052762    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430" event={"ID":"821f67db-8f20-444b-a4d8-93b699f2e36b","Type":"ContainerStarted","Data":"1c955b13699504c876bb880605504c66501fd9c8f49e49f71917ad6d152b7102"}
Oct 30 21:27:54.052911 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:54.052812    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430" event={"ID":"821f67db-8f20-444b-a4d8-93b699f2e36b","Type":"ContainerStarted","Data":"e026c8bb77d9bad094ecbf9c8062460f3e0c901f3710a9d6c7d1aa47bdeea7eb"}
Oct 30 21:27:54.054001 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:54.053982    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94e1ad7e0c854779103dedda603d66d1392329a7593f01ef887218de0b5e7ea2"
Oct 30 21:27:54.054001 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:54.053984    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"
Oct 30 21:27:54.171227 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:54.171185    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430" podStartSLOduration=1.171172795 podStartE2EDuration="1.171172795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:54.171125603 +0000 UTC m=+3049.127140477" watchObservedRunningTime="2026-10-30 21:27:54.171172795 +0000 UTC m=+3049.127187571"
Oct 30 21:27:54.223253 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:27:54.223195    5937 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9\" is forbidden: User \"system:node:ip-10-0-141-37.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-141-37.us-west-1.compute.internal' and this object" podUID="7746b9d6-9ff0-4def-b301-65b8601b73fe" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"
Oct 30 21:27:55.161989 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:55.161952    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7746b9d6-9ff0-4def-b301-65b8601b73fe" path="/var/lib/kubelet/pods/7746b9d6-9ff0-4def-b301-65b8601b73fe/volumes"
Oct 30 21:27:55.210211 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:27:55.210181    5937 status_manager.go:1045] "Failed to get status for pod" err="pods \"thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9\" is forbidden: User \"system:node:ip-10-0-141-37.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"redhat-ods-monitoring\": no relationship found between node 'ip-10-0-141-37.us-west-1.compute.internal' and this object" podUID="7746b9d6-9ff0-4def-b301-65b8601b73fe" pod="redhat-ods-monitoring/thanos-ingress-authenticated-proxy-18e36bdc75b6d9f9"
Oct 30 21:27:59.078347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:59.078319    5937 generic.go:356] "Generic (PLEG): container finished" podID="821f67db-8f20-444b-a4d8-93b699f2e36b" containerID="1c955b13699504c876bb880605504c66501fd9c8f49e49f71917ad6d152b7102" exitCode=0
Oct 30 21:27:59.078661 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:27:59.078374    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430" event={"ID":"821f67db-8f20-444b-a4d8-93b699f2e36b","Type":"ContainerDied","Data":"1c955b13699504c876bb880605504c66501fd9c8f49e49f71917ad6d152b7102"}
Oct 30 21:28:00.215676 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:00.215650    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430"
Oct 30 21:28:01.088593 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:01.088561    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430"
Oct 30 21:28:01.088761 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:01.088567    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430" event={"ID":"821f67db-8f20-444b-a4d8-93b699f2e36b","Type":"ContainerDied","Data":"e026c8bb77d9bad094ecbf9c8062460f3e0c901f3710a9d6c7d1aa47bdeea7eb"}
Oct 30 21:28:01.088761 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:01.088667    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e026c8bb77d9bad094ecbf9c8062460f3e0c901f3710a9d6c7d1aa47bdeea7eb"
Oct 30 21:28:01.615572 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:01.615523    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430"]
Oct 30 21:28:01.621156 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:01.621133    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["thanos-ingress-probe-18e36bdcf55b9039/thanos-ingress-untrusted-18e36bdcf679a430"]
Oct 30 21:28:03.161173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:03.161142    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="821f67db-8f20-444b-a4d8-93b699f2e36b" path="/var/lib/kubelet/pods/821f67db-8f20-444b-a4d8-93b699f2e36b/volumes"
Oct 30 21:28:06.087029 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:06.087000    5937 scope.go:122] "RemoveContainer" containerID="de87d3a701e1ae31cf38d8da7c7ba807b52b19bd354b05af222145e536e2820b"
Oct 30 21:28:15.671026 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:28:15.670945    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:28:26.884590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:26.884556    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"]
Oct 30 21:28:26.885033 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:26.884919    5937 cpu_manager.go:414] "containerMap: removing container" podUID="821f67db-8f20-444b-a4d8-93b699f2e36b" containerName="curl"
Oct 30 21:28:26.885033 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:26.884931    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="821f67db-8f20-444b-a4d8-93b699f2e36b" containerName="curl"
Oct 30 21:28:26.885033 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:26.885003    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="821f67db-8f20-444b-a4d8-93b699f2e36b" containerName="curl"
Oct 30 21:28:26.889323 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:26.889305    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:26.948024 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:26.947999    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"]
Oct 30 21:28:27.018686 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.018661    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66bdb557dc-vtdhx\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.018809 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.018717    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99cbl\" (UniqueName: \"kubernetes.io/projected/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-kube-api-access-99cbl\") pod \"data-science-collector-targetallocator-66bdb557dc-vtdhx\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.018851 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.018819    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-ta-internal\") pod \"data-science-collector-targetallocator-66bdb557dc-vtdhx\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.119844 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.119808    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66bdb557dc-vtdhx\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.120011 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.119866    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99cbl\" (UniqueName: \"kubernetes.io/projected/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-kube-api-access-99cbl\") pod \"data-science-collector-targetallocator-66bdb557dc-vtdhx\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.120011 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.119903    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-ta-internal\") pod \"data-science-collector-targetallocator-66bdb557dc-vtdhx\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.120480 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.120460    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-ta-internal\") pod \"data-science-collector-targetallocator-66bdb557dc-vtdhx\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.122522 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.122496    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-66bdb557dc-vtdhx\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.182787 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.182714    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99cbl\" (UniqueName: \"kubernetes.io/projected/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-kube-api-access-99cbl\") pod \"data-science-collector-targetallocator-66bdb557dc-vtdhx\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.200143 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.200120    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:27.571430 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.571406    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"]
Oct 30 21:28:27.573894 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:28:27.573867    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod804acd7d_d21f_4c4c_a7da_b48de9d6dbe0.slice/crio-4b22f1731a4f3aaa28627545fb5689b08f03682366e298f9120331ffb32a48ae WatchSource:0}: Error finding container 4b22f1731a4f3aaa28627545fb5689b08f03682366e298f9120331ffb32a48ae: Status 404 returned error can't find the container with id 4b22f1731a4f3aaa28627545fb5689b08f03682366e298f9120331ffb32a48ae
Oct 30 21:28:27.576064 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.576021    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:28:27.576146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:27.576107    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:28:28.209520 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:28.209488    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx" event={"ID":"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0","Type":"ContainerStarted","Data":"ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8"}
Oct 30 21:28:28.210028 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:28.209532    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx" event={"ID":"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0","Type":"ContainerStarted","Data":"4b22f1731a4f3aaa28627545fb5689b08f03682366e298f9120331ffb32a48ae"}
Oct 30 21:28:28.210028 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:28.209580    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:28.210836 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:28.210809    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx" podUID="804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.120:8080/readyz\": dial tcp 10.134.0.120:8080: connect: connection refused"
Oct 30 21:28:28.331229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:28.331173    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx" podStartSLOduration=2.331155379 podStartE2EDuration="2.331155379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:28.329717411 +0000 UTC m=+3083.285732188" watchObservedRunningTime="2026-10-30 21:28:28.331155379 +0000 UTC m=+3083.287170157"
Oct 30 21:28:29.214513 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.214487    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:28:29.367767 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.367735    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"]
Oct 30 21:28:29.367960 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.367903    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp" podUID="d7d38bee-dc06-473b-a794-792b79189050" containerName="ta-container" containerID="cri-o://0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d" gracePeriod=30
Oct 30 21:28:29.624759 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.624738    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:28:29.742712 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.742631    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7d38bee-dc06-473b-a794-792b79189050-ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7d38bee-dc06-473b-a794-792b79189050-ta-internal\") pod \"d7d38bee-dc06-473b-a794-792b79189050\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") "
Oct 30 21:28:29.742712 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.742692    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d7d38bee-dc06-473b-a794-792b79189050-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7d38bee-dc06-473b-a794-792b79189050-data-science-collector-ta-server-cert\") pod \"d7d38bee-dc06-473b-a794-792b79189050\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") "
Oct 30 21:28:29.742950 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.742794    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7d38bee-dc06-473b-a794-792b79189050-kube-api-access-ddmrc\" (UniqueName: \"kubernetes.io/projected/d7d38bee-dc06-473b-a794-792b79189050-kube-api-access-ddmrc\") pod \"d7d38bee-dc06-473b-a794-792b79189050\" (UID: \"d7d38bee-dc06-473b-a794-792b79189050\") "
Oct 30 21:28:29.743378 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.743230    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7d38bee-dc06-473b-a794-792b79189050-ta-internal" pod "d7d38bee-dc06-473b-a794-792b79189050" (UID: "d7d38bee-dc06-473b-a794-792b79189050"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:28:29.743530 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.743489    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d7d38bee-dc06-473b-a794-792b79189050-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:29.745853 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.745828    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7d38bee-dc06-473b-a794-792b79189050-data-science-collector-ta-server-cert" pod "d7d38bee-dc06-473b-a794-792b79189050" (UID: "d7d38bee-dc06-473b-a794-792b79189050"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:28:29.746044 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.746021    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7d38bee-dc06-473b-a794-792b79189050-kube-api-access-ddmrc" pod "d7d38bee-dc06-473b-a794-792b79189050" (UID: "d7d38bee-dc06-473b-a794-792b79189050"). InnerVolumeSpecName "kube-api-access-ddmrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:28:29.762395 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.762373    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:28:29.762751 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.762739    5937 cpu_manager.go:414] "containerMap: removing container" podUID="d7d38bee-dc06-473b-a794-792b79189050" containerName="ta-container"
Oct 30 21:28:29.762807 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.762754    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7d38bee-dc06-473b-a794-792b79189050" containerName="ta-container"
Oct 30 21:28:29.762849 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.762834    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7d38bee-dc06-473b-a794-792b79189050" containerName="ta-container"
Oct 30 21:28:29.765939 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.765920    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.820010 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.819981    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:28:29.820127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.820026    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:28:29.820127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.820053    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:28:29.820127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.820056    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:28:29.820127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.820093    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-6d9d4583\""
Oct 30 21:28:29.820127 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.820110    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:28:29.844679 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.844656    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.844811 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.844695    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.844811 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.844722    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9ab2efbb-84a6-46ac-983f-b2986f237975-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.844811 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.844771    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.844994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.844885    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9gkk\" (UniqueName: \"kubernetes.io/projected/9ab2efbb-84a6-46ac-983f-b2986f237975-kube-api-access-s9gkk\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.844994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.844910    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.844994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.844975    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d7d38bee-dc06-473b-a794-792b79189050-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:29.844994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.844991    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddmrc\" (UniqueName: \"kubernetes.io/projected/d7d38bee-dc06-473b-a794-792b79189050-kube-api-access-ddmrc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:28:29.870920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.870893    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:28:29.945782 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.945755    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9ab2efbb-84a6-46ac-983f-b2986f237975-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.945891 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.945786    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.945891 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.945831    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9gkk\" (UniqueName: \"kubernetes.io/projected/9ab2efbb-84a6-46ac-983f-b2986f237975-kube-api-access-s9gkk\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.945891 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.945860    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.946067 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.945899    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.946067 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.945945    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.946583 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.946524    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9ab2efbb-84a6-46ac-983f-b2986f237975-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.948528 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.948503    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.948655 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.948612    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.948655 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.948619    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:29.948735 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:29.948665    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:30.008352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.008303    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9gkk\" (UniqueName: \"kubernetes.io/projected/9ab2efbb-84a6-46ac-983f-b2986f237975-kube-api-access-s9gkk\") pod \"data-science-collector-collector-1\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:30.078987 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.078964    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:28:30.220645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.220615    5937 generic.go:356] "Generic (PLEG): container finished" podID="d7d38bee-dc06-473b-a794-792b79189050" containerID="0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d" exitCode=0
Oct 30 21:28:30.221066 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.220660    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"
Oct 30 21:28:30.221066 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.220704    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp" event={"ID":"d7d38bee-dc06-473b-a794-792b79189050","Type":"ContainerDied","Data":"0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d"}
Oct 30 21:28:30.221066 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.220752    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp" event={"ID":"d7d38bee-dc06-473b-a794-792b79189050","Type":"ContainerDied","Data":"36c6c6e54dfb83c25877125dbabf0434f120e9b09f2dd18ccc13f36d89af1bed"}
Oct 30 21:28:30.221066 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.220778    5937 scope.go:122] "RemoveContainer" containerID="0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d"
Oct 30 21:28:30.229680 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.229663    5937 scope.go:122] "RemoveContainer" containerID="0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d"
Oct 30 21:28:30.229941 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:28:30.229923    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d\": container with ID starting with 0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d not found: ID does not exist" containerID="0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d"
Oct 30 21:28:30.230000 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.229953    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d"} err="failed to get container status \"0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d\": rpc error: code = NotFound desc = could not find container \"0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d\": container with ID starting with 0201034e34a9c58be830cb4cca535a67d8e7bdfac6c9e230c6b634416ca3aa1d not found: ID does not exist"
Oct 30 21:28:30.442585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.442497    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"]
Oct 30 21:28:30.450767 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.450746    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-77b4c4c5c8-5xbmp"]
Oct 30 21:28:30.461923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.461900    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:28:30.494372 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:28:30.494348    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab2efbb_84a6_46ac_983f_b2986f237975.slice/crio-c5911452f7970fb2c05b700a51e65f1442a4d02a0af54ec8282ed77d96fa1d7c WatchSource:0}: Error finding container c5911452f7970fb2c05b700a51e65f1442a4d02a0af54ec8282ed77d96fa1d7c: Status 404 returned error can't find the container with id c5911452f7970fb2c05b700a51e65f1442a4d02a0af54ec8282ed77d96fa1d7c
Oct 30 21:28:30.496683 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.496656    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:28:30.496771 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:30.496714    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:28:31.162095 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:31.162066    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7d38bee-dc06-473b-a794-792b79189050" path="/var/lib/kubelet/pods/d7d38bee-dc06-473b-a794-792b79189050/volumes"
Oct 30 21:28:31.227806 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:31.227772    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"9ab2efbb-84a6-46ac-983f-b2986f237975","Type":"ContainerStarted","Data":"420dfd46bd4f1db7ede5846131109e0918b051133d884826e5261d00e44333a8"}
Oct 30 21:28:31.228199 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:31.227821    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"9ab2efbb-84a6-46ac-983f-b2986f237975","Type":"ContainerStarted","Data":"c5911452f7970fb2c05b700a51e65f1442a4d02a0af54ec8282ed77d96fa1d7c"}
Oct 30 21:28:31.358468 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:31.358424    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=2.358411756 podStartE2EDuration="2.358411756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:31.356975008 +0000 UTC m=+3086.312989810" watchObservedRunningTime="2026-10-30 21:28:31.358411756 +0000 UTC m=+3086.314426529"
Oct 30 21:28:45.671326 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:28:45.671276    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:28:59.230311 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:59.230277    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:28:59.230743 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:59.230496    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="9ab2efbb-84a6-46ac-983f-b2986f237975" containerName="otc-container" containerID="cri-o://420dfd46bd4f1db7ede5846131109e0918b051133d884826e5261d00e44333a8" gracePeriod=30
Oct 30 21:28:59.885125 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:59.885087    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"]
Oct 30 21:28:59.888655 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:59.888638    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:28:59.907008 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:59.906984    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5b7e38c5-4367-46de-8739-2bf413c4e3dc-ta-internal\") pod \"data-science-collector-targetallocator-6d4774986d-vc5z9\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:28:59.907141 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:59.907013    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5b7e38c5-4367-46de-8739-2bf413c4e3dc-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d4774986d-vc5z9\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:28:59.907141 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:59.907033    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s5xx\" (UniqueName: \"kubernetes.io/projected/5b7e38c5-4367-46de-8739-2bf413c4e3dc-kube-api-access-8s5xx\") pod \"data-science-collector-targetallocator-6d4774986d-vc5z9\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:28:59.949179 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:28:59.949144    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"]
Oct 30 21:29:00.008489 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.008454    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5b7e38c5-4367-46de-8739-2bf413c4e3dc-ta-internal\") pod \"data-science-collector-targetallocator-6d4774986d-vc5z9\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:00.008489 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.008489    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5b7e38c5-4367-46de-8739-2bf413c4e3dc-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d4774986d-vc5z9\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:00.008735 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.008509    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s5xx\" (UniqueName: \"kubernetes.io/projected/5b7e38c5-4367-46de-8739-2bf413c4e3dc-kube-api-access-8s5xx\") pod \"data-science-collector-targetallocator-6d4774986d-vc5z9\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:00.009135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.009107    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5b7e38c5-4367-46de-8739-2bf413c4e3dc-ta-internal\") pod \"data-science-collector-targetallocator-6d4774986d-vc5z9\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:00.011683 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.011650    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5b7e38c5-4367-46de-8739-2bf413c4e3dc-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d4774986d-vc5z9\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:00.071484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.071440    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s5xx\" (UniqueName: \"kubernetes.io/projected/5b7e38c5-4367-46de-8739-2bf413c4e3dc-kube-api-access-8s5xx\") pod \"data-science-collector-targetallocator-6d4774986d-vc5z9\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:00.199404 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.199311    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:00.364949 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.364920    5937 generic.go:356] "Generic (PLEG): container finished" podID="9ab2efbb-84a6-46ac-983f-b2986f237975" containerID="420dfd46bd4f1db7ede5846131109e0918b051133d884826e5261d00e44333a8" exitCode=0
Oct 30 21:29:00.365314 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.364973    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"9ab2efbb-84a6-46ac-983f-b2986f237975","Type":"ContainerDied","Data":"420dfd46bd4f1db7ede5846131109e0918b051133d884826e5261d00e44333a8"}
Oct 30 21:29:00.471238 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.471213    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:00.512158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.512123    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-tls-certs\") pod \"9ab2efbb-84a6-46ac-983f-b2986f237975\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") "
Oct 30 21:29:00.512327 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.512167    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ab2efbb-84a6-46ac-983f-b2986f237975-otc-internal\" (UniqueName: \"kubernetes.io/configmap/9ab2efbb-84a6-46ac-983f-b2986f237975-otc-internal\") pod \"9ab2efbb-84a6-46ac-983f-b2986f237975\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") "
Oct 30 21:29:00.512327 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.512186    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-data-science-collector-ta-client-cert\") pod \"9ab2efbb-84a6-46ac-983f-b2986f237975\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") "
Oct 30 21:29:00.512327 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.512253    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-monitoring-tls-certs\") pod \"9ab2efbb-84a6-46ac-983f-b2986f237975\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") "
Oct 30 21:29:00.512327 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.512272    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ab2efbb-84a6-46ac-983f-b2986f237975-kube-api-access-s9gkk\" (UniqueName: \"kubernetes.io/projected/9ab2efbb-84a6-46ac-983f-b2986f237975-kube-api-access-s9gkk\") pod \"9ab2efbb-84a6-46ac-983f-b2986f237975\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") "
Oct 30 21:29:00.512327 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.512308    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-otlp-tls-certs\") pod \"9ab2efbb-84a6-46ac-983f-b2986f237975\" (UID: \"9ab2efbb-84a6-46ac-983f-b2986f237975\") "
Oct 30 21:29:00.512694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.512639    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ab2efbb-84a6-46ac-983f-b2986f237975-otc-internal" pod "9ab2efbb-84a6-46ac-983f-b2986f237975" (UID: "9ab2efbb-84a6-46ac-983f-b2986f237975"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:29:00.514638 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.514608    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-monitoring-tls-certs" pod "9ab2efbb-84a6-46ac-983f-b2986f237975" (UID: "9ab2efbb-84a6-46ac-983f-b2986f237975"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:00.515020 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.514995    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-otlp-tls-certs" pod "9ab2efbb-84a6-46ac-983f-b2986f237975" (UID: "9ab2efbb-84a6-46ac-983f-b2986f237975"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:00.515098 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.515060    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab2efbb-84a6-46ac-983f-b2986f237975-kube-api-access-s9gkk" pod "9ab2efbb-84a6-46ac-983f-b2986f237975" (UID: "9ab2efbb-84a6-46ac-983f-b2986f237975"). InnerVolumeSpecName "kube-api-access-s9gkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:00.515158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.515128    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-data-science-collector-ta-client-cert" pod "9ab2efbb-84a6-46ac-983f-b2986f237975" (UID: "9ab2efbb-84a6-46ac-983f-b2986f237975"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:00.515195 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.515151    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-tls-certs" pod "9ab2efbb-84a6-46ac-983f-b2986f237975" (UID: "9ab2efbb-84a6-46ac-983f-b2986f237975"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:00.573764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.573740    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"]
Oct 30 21:29:00.576495 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:29:00.576467    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b7e38c5_4367_46de_8739_2bf413c4e3dc.slice/crio-b8b37c9ccf6ed5a110d0cc0e3dd061a8dec6ee24243040a768336aed8297b4c1 WatchSource:0}: Error finding container b8b37c9ccf6ed5a110d0cc0e3dd061a8dec6ee24243040a768336aed8297b4c1: Status 404 returned error can't find the container with id b8b37c9ccf6ed5a110d0cc0e3dd061a8dec6ee24243040a768336aed8297b4c1
Oct 30 21:29:00.578774 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.578743    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:00.578883 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.578811    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:00.613091 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.613061    5937 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:00.613091 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.613085    5937 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9ab2efbb-84a6-46ac-983f-b2986f237975-otc-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:00.613239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.613095    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-data-science-collector-ta-client-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:00.613239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.613106    5937 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-monitoring-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:00.613239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.613115    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9gkk\" (UniqueName: \"kubernetes.io/projected/9ab2efbb-84a6-46ac-983f-b2986f237975-kube-api-access-s9gkk\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:00.613239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:00.613124    5937 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9ab2efbb-84a6-46ac-983f-b2986f237975-otlp-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:01.371622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.371501    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9" event={"ID":"5b7e38c5-4367-46de-8739-2bf413c4e3dc","Type":"ContainerStarted","Data":"56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca"}
Oct 30 21:29:01.372087 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.371677    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:01.372087 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.371711    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9" event={"ID":"5b7e38c5-4367-46de-8739-2bf413c4e3dc","Type":"ContainerStarted","Data":"b8b37c9ccf6ed5a110d0cc0e3dd061a8dec6ee24243040a768336aed8297b4c1"}
Oct 30 21:29:01.373034 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.373002    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9" podUID="5b7e38c5-4367-46de-8739-2bf413c4e3dc" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.122:8080/readyz\": dial tcp 10.134.0.122:8080: connect: connection refused"
Oct 30 21:29:01.373162 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.373036    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"9ab2efbb-84a6-46ac-983f-b2986f237975","Type":"ContainerDied","Data":"c5911452f7970fb2c05b700a51e65f1442a4d02a0af54ec8282ed77d96fa1d7c"}
Oct 30 21:29:01.373162 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.373055    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.373162 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.373080    5937 scope.go:122] "RemoveContainer" containerID="420dfd46bd4f1db7ede5846131109e0918b051133d884826e5261d00e44333a8"
Oct 30 21:29:01.490233 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.490182    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9" podStartSLOduration=2.490168225 podStartE2EDuration="2.490168225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:01.489512086 +0000 UTC m=+3116.445526863" watchObservedRunningTime="2026-10-30 21:29:01.490168225 +0000 UTC m=+3116.446183000"
Oct 30 21:29:01.602261 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.602224    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:01.605699 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.605674    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:01.691951 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.691870    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:01.692303 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.692285    5937 cpu_manager.go:414] "containerMap: removing container" podUID="9ab2efbb-84a6-46ac-983f-b2986f237975" containerName="otc-container"
Oct 30 21:29:01.692394 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.692306    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ab2efbb-84a6-46ac-983f-b2986f237975" containerName="otc-container"
Oct 30 21:29:01.692453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.692441    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ab2efbb-84a6-46ac-983f-b2986f237975" containerName="otc-container"
Oct 30 21:29:01.696765 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.696743    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.724025 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.724003    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.724154 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.724049    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bblrd\" (UniqueName: \"kubernetes.io/projected/9da3612f-3853-4b94-80ef-4c8559a00c1e-kube-api-access-bblrd\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.724198 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.724175    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.724249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.724198    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9da3612f-3853-4b94-80ef-4c8559a00c1e-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.724249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.724234    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.724318 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.724272    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.751443 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.751414    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:29:01.751633 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.751616    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:29:01.751692 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.751663    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:29:01.754355 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.754335    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:29:01.755178 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.755160    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:29:01.756278 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.756257    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:01.825446 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.825415    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.825653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.825454    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9da3612f-3853-4b94-80ef-4c8559a00c1e-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.825653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.825492    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.825653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.825520    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.825825 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.825667    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.825825 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.825760    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bblrd\" (UniqueName: \"kubernetes.io/projected/9da3612f-3853-4b94-80ef-4c8559a00c1e-kube-api-access-bblrd\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.826209 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.826186    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9da3612f-3853-4b94-80ef-4c8559a00c1e-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.828193 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.828167    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.828312 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.828239    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.828312 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.828248    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.851806 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.851781    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:29:01.858293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.858270    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:01.887420 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:01.887389    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bblrd\" (UniqueName: \"kubernetes.io/projected/9da3612f-3853-4b94-80ef-4c8559a00c1e-kube-api-access-bblrd\") pod \"data-science-collector-collector-1\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:02.009097 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.009069    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:02.379496 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.379412    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:02.386438 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.386410    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:02.389318 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:29:02.389296    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da3612f_3853_4b94_80ef_4c8559a00c1e.slice/crio-4d65004b2298193efc95589b0105f26b7594e643bee332b353cc94682d3d0dfe WatchSource:0}: Error finding container 4d65004b2298193efc95589b0105f26b7594e643bee332b353cc94682d3d0dfe: Status 404 returned error can't find the container with id 4d65004b2298193efc95589b0105f26b7594e643bee332b353cc94682d3d0dfe
Oct 30 21:29:02.391481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.391441    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:02.391581 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.391509    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:02.541336 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.541295    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"]
Oct 30 21:29:02.541630 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.541596    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx" podUID="804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" containerName="ta-container" containerID="cri-o://ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8" gracePeriod=30
Oct 30 21:29:02.773831 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.773806    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:29:02.834136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.834102    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-ta-internal\" (UniqueName: \"kubernetes.io/configmap/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-ta-internal\") pod \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") "
Oct 30 21:29:02.834323 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.834208    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-data-science-collector-ta-server-cert\") pod \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") "
Oct 30 21:29:02.834323 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.834247    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-kube-api-access-99cbl\" (UniqueName: \"kubernetes.io/projected/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-kube-api-access-99cbl\") pod \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\" (UID: \"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0\") "
Oct 30 21:29:02.834484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.834460    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-ta-internal" pod "804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" (UID: "804acd7d-d21f-4c4c-a7da-b48de9d6dbe0"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:29:02.836394 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.836372    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-data-science-collector-ta-server-cert" pod "804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" (UID: "804acd7d-d21f-4c4c-a7da-b48de9d6dbe0"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:02.836549 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.836513    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-kube-api-access-99cbl" pod "804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" (UID: "804acd7d-d21f-4c4c-a7da-b48de9d6dbe0"). InnerVolumeSpecName "kube-api-access-99cbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:02.935170 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.935084    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:02.935170 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.935114    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99cbl\" (UniqueName: \"kubernetes.io/projected/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-kube-api-access-99cbl\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:02.935170 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:02.935125    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:03.162176 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.162142    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ab2efbb-84a6-46ac-983f-b2986f237975" path="/var/lib/kubelet/pods/9ab2efbb-84a6-46ac-983f-b2986f237975/volumes"
Oct 30 21:29:03.384698 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.384657    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"9da3612f-3853-4b94-80ef-4c8559a00c1e","Type":"ContainerStarted","Data":"6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a"}
Oct 30 21:29:03.385163 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.384729    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"9da3612f-3853-4b94-80ef-4c8559a00c1e","Type":"ContainerStarted","Data":"4d65004b2298193efc95589b0105f26b7594e643bee332b353cc94682d3d0dfe"}
Oct 30 21:29:03.385988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.385951    5937 generic.go:356] "Generic (PLEG): container finished" podID="804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" containerID="ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8" exitCode=0
Oct 30 21:29:03.386117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.386005    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"
Oct 30 21:29:03.386117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.386046    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx" event={"ID":"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0","Type":"ContainerDied","Data":"ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8"}
Oct 30 21:29:03.386117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.386096    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx" event={"ID":"804acd7d-d21f-4c4c-a7da-b48de9d6dbe0","Type":"ContainerDied","Data":"4b22f1731a4f3aaa28627545fb5689b08f03682366e298f9120331ffb32a48ae"}
Oct 30 21:29:03.386265 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.386130    5937 scope.go:122] "RemoveContainer" containerID="ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8"
Oct 30 21:29:03.394742 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.394719    5937 scope.go:122] "RemoveContainer" containerID="ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8"
Oct 30 21:29:03.395015 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:29:03.394997    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8\": container with ID starting with ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8 not found: ID does not exist" containerID="ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8"
Oct 30 21:29:03.395068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.395024    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8"} err="failed to get container status \"ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8\": rpc error: code = NotFound desc = could not find container \"ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8\": container with ID starting with ebec9350d52021189f97e40ad549fece830e3294d9c1bb2779b1465c27547cd8 not found: ID does not exist"
Oct 30 21:29:03.505703 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.505654    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=2.505638616 podStartE2EDuration="2.505638616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:03.504611785 +0000 UTC m=+3118.460626566" watchObservedRunningTime="2026-10-30 21:29:03.505638616 +0000 UTC m=+3118.461653386"
Oct 30 21:29:03.617988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.617951    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"]
Oct 30 21:29:03.621735 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:03.621706    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-66bdb557dc-vtdhx"]
Oct 30 21:29:05.161011 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:05.160975    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" path="/var/lib/kubelet/pods/804acd7d-d21f-4c4c-a7da-b48de9d6dbe0/volumes"
Oct 30 21:29:15.672901 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:29:15.672860    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:29:32.526131 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:32.526099    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:32.526649 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:32.526330    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="9da3612f-3853-4b94-80ef-4c8559a00c1e" containerName="otc-container" containerID="cri-o://6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a" gracePeriod=30
Oct 30 21:29:33.179253 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.179224    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"]
Oct 30 21:29:33.179671 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.179656    5937 cpu_manager.go:414] "containerMap: removing container" podUID="804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" containerName="ta-container"
Oct 30 21:29:33.179725 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.179672    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" containerName="ta-container"
Oct 30 21:29:33.179780 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.179771    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="804acd7d-d21f-4c4c-a7da-b48de9d6dbe0" containerName="ta-container"
Oct 30 21:29:33.184152 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.184135    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.241122 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.241096    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"]
Oct 30 21:29:33.402613 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.402578    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v4k8\" (UniqueName: \"kubernetes.io/projected/817287a7-c4c3-4a46-b193-36ce122527ea-kube-api-access-2v4k8\") pod \"data-science-collector-targetallocator-57f8d466b9-9jrzs\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.402786 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.402640    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/817287a7-c4c3-4a46-b193-36ce122527ea-ta-internal\") pod \"data-science-collector-targetallocator-57f8d466b9-9jrzs\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.402786 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.402758    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/817287a7-c4c3-4a46-b193-36ce122527ea-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57f8d466b9-9jrzs\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.503985 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.503953    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v4k8\" (UniqueName: \"kubernetes.io/projected/817287a7-c4c3-4a46-b193-36ce122527ea-kube-api-access-2v4k8\") pod \"data-science-collector-targetallocator-57f8d466b9-9jrzs\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.504120 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.503993    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/817287a7-c4c3-4a46-b193-36ce122527ea-ta-internal\") pod \"data-science-collector-targetallocator-57f8d466b9-9jrzs\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.504120 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.504024    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/817287a7-c4c3-4a46-b193-36ce122527ea-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57f8d466b9-9jrzs\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.504661 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.504638    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/817287a7-c4c3-4a46-b193-36ce122527ea-ta-internal\") pod \"data-science-collector-targetallocator-57f8d466b9-9jrzs\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.506679 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.506661    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/817287a7-c4c3-4a46-b193-36ce122527ea-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-57f8d466b9-9jrzs\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.566662 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.566636    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v4k8\" (UniqueName: \"kubernetes.io/projected/817287a7-c4c3-4a46-b193-36ce122527ea-kube-api-access-2v4k8\") pod \"data-science-collector-targetallocator-57f8d466b9-9jrzs\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:33.795258 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:33.795192    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:34.169995 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:34.169974    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"]
Oct 30 21:29:34.172657 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:29:34.172632    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod817287a7_c4c3_4a46_b193_36ce122527ea.slice/crio-9c959aa8a3d4757d2be79fcf4b20d916b99aa1aae46614ea2b0b1f27854e3251 WatchSource:0}: Error finding container 9c959aa8a3d4757d2be79fcf4b20d916b99aa1aae46614ea2b0b1f27854e3251: Status 404 returned error can't find the container with id 9c959aa8a3d4757d2be79fcf4b20d916b99aa1aae46614ea2b0b1f27854e3251
Oct 30 21:29:34.174900 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:34.174869    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:34.175006 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:34.174924    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:34.529524 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:34.529495    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs" event={"ID":"817287a7-c4c3-4a46-b193-36ce122527ea","Type":"ContainerStarted","Data":"66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b"}
Oct 30 21:29:34.529906 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:34.529553    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs" event={"ID":"817287a7-c4c3-4a46-b193-36ce122527ea","Type":"ContainerStarted","Data":"9c959aa8a3d4757d2be79fcf4b20d916b99aa1aae46614ea2b0b1f27854e3251"}
Oct 30 21:29:34.529906 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:34.529648    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:34.530848 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:34.530821    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs" podUID="817287a7-c4c3-4a46-b193-36ce122527ea" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.124:8080/readyz\": dial tcp 10.134.0.124:8080: connect: connection refused"
Oct 30 21:29:34.648779 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:34.648732    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs" podStartSLOduration=1.6487190090000001 podStartE2EDuration="1.648719009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:34.647905238 +0000 UTC m=+3149.603920015" watchObservedRunningTime="2026-10-30 21:29:34.648719009 +0000 UTC m=+3149.604733848"
Oct 30 21:29:34.866237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:34.866214    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:35.019183 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.019156    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-data-science-collector-ta-client-cert\") pod \"9da3612f-3853-4b94-80ef-4c8559a00c1e\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") "
Oct 30 21:29:35.019365 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.019243    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9da3612f-3853-4b94-80ef-4c8559a00c1e-kube-api-access-bblrd\" (UniqueName: \"kubernetes.io/projected/9da3612f-3853-4b94-80ef-4c8559a00c1e-kube-api-access-bblrd\") pod \"9da3612f-3853-4b94-80ef-4c8559a00c1e\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") "
Oct 30 21:29:35.019438 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.019376    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-otlp-tls-certs\") pod \"9da3612f-3853-4b94-80ef-4c8559a00c1e\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") "
Oct 30 21:29:35.019438 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.019425    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-tls-certs\") pod \"9da3612f-3853-4b94-80ef-4c8559a00c1e\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") "
Oct 30 21:29:35.019585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.019461    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9da3612f-3853-4b94-80ef-4c8559a00c1e-otc-internal\" (UniqueName: \"kubernetes.io/configmap/9da3612f-3853-4b94-80ef-4c8559a00c1e-otc-internal\") pod \"9da3612f-3853-4b94-80ef-4c8559a00c1e\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") "
Oct 30 21:29:35.019585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.019503    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-monitoring-tls-certs\") pod \"9da3612f-3853-4b94-80ef-4c8559a00c1e\" (UID: \"9da3612f-3853-4b94-80ef-4c8559a00c1e\") "
Oct 30 21:29:35.020321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.020290    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9da3612f-3853-4b94-80ef-4c8559a00c1e-otc-internal" pod "9da3612f-3853-4b94-80ef-4c8559a00c1e" (UID: "9da3612f-3853-4b94-80ef-4c8559a00c1e"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:29:35.021785 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.021746    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9da3612f-3853-4b94-80ef-4c8559a00c1e-kube-api-access-bblrd" pod "9da3612f-3853-4b94-80ef-4c8559a00c1e" (UID: "9da3612f-3853-4b94-80ef-4c8559a00c1e"). InnerVolumeSpecName "kube-api-access-bblrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:35.022723 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.022698    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-otlp-tls-certs" pod "9da3612f-3853-4b94-80ef-4c8559a00c1e" (UID: "9da3612f-3853-4b94-80ef-4c8559a00c1e"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:35.022840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.022723    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-monitoring-tls-certs" pod "9da3612f-3853-4b94-80ef-4c8559a00c1e" (UID: "9da3612f-3853-4b94-80ef-4c8559a00c1e"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:35.022840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.022744    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-data-science-collector-ta-client-cert" pod "9da3612f-3853-4b94-80ef-4c8559a00c1e" (UID: "9da3612f-3853-4b94-80ef-4c8559a00c1e"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:35.022840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.022789    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-tls-certs" pod "9da3612f-3853-4b94-80ef-4c8559a00c1e" (UID: "9da3612f-3853-4b94-80ef-4c8559a00c1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:35.121007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.120932    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-data-science-collector-ta-client-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:35.121007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.120961    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bblrd\" (UniqueName: \"kubernetes.io/projected/9da3612f-3853-4b94-80ef-4c8559a00c1e-kube-api-access-bblrd\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:35.121007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.120974    5937 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-otlp-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:35.121007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.120983    5937 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:35.121007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.120992    5937 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/9da3612f-3853-4b94-80ef-4c8559a00c1e-otc-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:35.121007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.121001    5937 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/9da3612f-3853-4b94-80ef-4c8559a00c1e-monitoring-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:35.535052 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.535017    5937 generic.go:356] "Generic (PLEG): container finished" podID="9da3612f-3853-4b94-80ef-4c8559a00c1e" containerID="6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a" exitCode=0
Oct 30 21:29:35.535235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.535065    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:35.535235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.535108    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"9da3612f-3853-4b94-80ef-4c8559a00c1e","Type":"ContainerDied","Data":"6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a"}
Oct 30 21:29:35.535235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.535177    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"9da3612f-3853-4b94-80ef-4c8559a00c1e","Type":"ContainerDied","Data":"4d65004b2298193efc95589b0105f26b7594e643bee332b353cc94682d3d0dfe"}
Oct 30 21:29:35.535235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.535207    5937 scope.go:122] "RemoveContainer" containerID="6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a"
Oct 30 21:29:35.536479 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.536464    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:29:35.543802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.543785    5937 scope.go:122] "RemoveContainer" containerID="6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a"
Oct 30 21:29:35.544053 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:29:35.544032    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a\": container with ID starting with 6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a not found: ID does not exist" containerID="6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a"
Oct 30 21:29:35.544121 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.544064    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a"} err="failed to get container status \"6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a\": rpc error: code = NotFound desc = could not find container \"6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a\": container with ID starting with 6c2deee34e549deb2323e1f09963bb74b29161e246a84ebc0466bf9be044c59a not found: ID does not exist"
Oct 30 21:29:35.759983 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.759953    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"]
Oct 30 21:29:35.760355 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.760135    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9" podUID="5b7e38c5-4367-46de-8739-2bf413c4e3dc" containerName="ta-container" containerID="cri-o://56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca" gracePeriod=30
Oct 30 21:29:35.823438 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.823365    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:35.829731 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.829709    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:35.906616 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.906582    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:35.907145 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.907124    5937 cpu_manager.go:414] "containerMap: removing container" podUID="9da3612f-3853-4b94-80ef-4c8559a00c1e" containerName="otc-container"
Oct 30 21:29:35.907242 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.907148    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9da3612f-3853-4b94-80ef-4c8559a00c1e" containerName="otc-container"
Oct 30 21:29:35.907299 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.907254    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="9da3612f-3853-4b94-80ef-4c8559a00c1e" containerName="otc-container"
Oct 30 21:29:35.910314 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.910295    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:35.964522 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.964492    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:29:35.964522 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.964507    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:29:35.964762 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.964597    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:29:35.964762 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.964602    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:29:35.964762 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.964630    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:29:35.964762 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.964656    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-6d9d4583\""
Oct 30 21:29:35.968834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:35.968812    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:36.024593 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.024572    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:36.030726 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.030695    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.030806 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.030735    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.030859 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.030840    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhf6t\" (UniqueName: \"kubernetes.io/projected/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-kube-api-access-xhf6t\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.030903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.030889    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.030979 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.030960    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.031018 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.030988    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.131644 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.131528    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b7e38c5-4367-46de-8739-2bf413c4e3dc-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5b7e38c5-4367-46de-8739-2bf413c4e3dc-data-science-collector-ta-server-cert\") pod \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") "
Oct 30 21:29:36.131792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.131665    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b7e38c5-4367-46de-8739-2bf413c4e3dc-ta-internal\" (UniqueName: \"kubernetes.io/configmap/5b7e38c5-4367-46de-8739-2bf413c4e3dc-ta-internal\") pod \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") "
Oct 30 21:29:36.131792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.131696    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b7e38c5-4367-46de-8739-2bf413c4e3dc-kube-api-access-8s5xx\" (UniqueName: \"kubernetes.io/projected/5b7e38c5-4367-46de-8739-2bf413c4e3dc-kube-api-access-8s5xx\") pod \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\" (UID: \"5b7e38c5-4367-46de-8739-2bf413c4e3dc\") "
Oct 30 21:29:36.131901 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.131813    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhf6t\" (UniqueName: \"kubernetes.io/projected/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-kube-api-access-xhf6t\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.131901 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.131876    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.132004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.131916    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.132004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.131939    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.132004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.132000    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.132151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.132016    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b7e38c5-4367-46de-8739-2bf413c4e3dc-ta-internal" pod "5b7e38c5-4367-46de-8739-2bf413c4e3dc" (UID: "5b7e38c5-4367-46de-8739-2bf413c4e3dc"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:29:36.132151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.132033    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.132151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.132081    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5b7e38c5-4367-46de-8739-2bf413c4e3dc-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:36.132984 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.132952    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.134317 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.134285    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b7e38c5-4367-46de-8739-2bf413c4e3dc-data-science-collector-ta-server-cert" pod "5b7e38c5-4367-46de-8739-2bf413c4e3dc" (UID: "5b7e38c5-4367-46de-8739-2bf413c4e3dc"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:29:36.134726 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.134688    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7e38c5-4367-46de-8739-2bf413c4e3dc-kube-api-access-8s5xx" pod "5b7e38c5-4367-46de-8739-2bf413c4e3dc" (UID: "5b7e38c5-4367-46de-8739-2bf413c4e3dc"). InnerVolumeSpecName "kube-api-access-8s5xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:29:36.134988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.134970    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.135157 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.135138    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.135277 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.135257    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.135351 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.135337    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.193636 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.193613    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhf6t\" (UniqueName: \"kubernetes.io/projected/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-kube-api-access-xhf6t\") pod \"data-science-collector-collector-1\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.223432 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.223408    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:29:36.232869 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.232628    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s5xx\" (UniqueName: \"kubernetes.io/projected/5b7e38c5-4367-46de-8739-2bf413c4e3dc-kube-api-access-8s5xx\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:36.232869 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.232653    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5b7e38c5-4367-46de-8739-2bf413c4e3dc-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:29:36.541235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.541205    5937 generic.go:356] "Generic (PLEG): container finished" podID="5b7e38c5-4367-46de-8739-2bf413c4e3dc" containerID="56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca" exitCode=0
Oct 30 21:29:36.541398 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.541251    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"
Oct 30 21:29:36.541398 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.541275    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9" event={"ID":"5b7e38c5-4367-46de-8739-2bf413c4e3dc","Type":"ContainerDied","Data":"56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca"}
Oct 30 21:29:36.541398 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.541300    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9" event={"ID":"5b7e38c5-4367-46de-8739-2bf413c4e3dc","Type":"ContainerDied","Data":"b8b37c9ccf6ed5a110d0cc0e3dd061a8dec6ee24243040a768336aed8297b4c1"}
Oct 30 21:29:36.541398 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.541320    5937 scope.go:122] "RemoveContainer" containerID="56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca"
Oct 30 21:29:36.550473 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.550456    5937 scope.go:122] "RemoveContainer" containerID="56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca"
Oct 30 21:29:36.550722 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:29:36.550704    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca\": container with ID starting with 56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca not found: ID does not exist" containerID="56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca"
Oct 30 21:29:36.550776 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.550730    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca"} err="failed to get container status \"56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca\": rpc error: code = NotFound desc = could not find container \"56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca\": container with ID starting with 56c87b1957fdce2fa5f5c4c1d18799edb2f2a439314eb607ddba9d6b2a02d6ca not found: ID does not exist"
Oct 30 21:29:36.595527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.595504    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:29:36.602511 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.602486    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:36.602623 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.602558    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:29:36.708198 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.708165    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"]
Oct 30 21:29:36.713167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:36.713141    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d4774986d-vc5z9"]
Oct 30 21:29:37.168154 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:37.168120    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b7e38c5-4367-46de-8739-2bf413c4e3dc" path="/var/lib/kubelet/pods/5b7e38c5-4367-46de-8739-2bf413c4e3dc/volumes"
Oct 30 21:29:37.168556 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:37.168527    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9da3612f-3853-4b94-80ef-4c8559a00c1e" path="/var/lib/kubelet/pods/9da3612f-3853-4b94-80ef-4c8559a00c1e/volumes"
Oct 30 21:29:37.549518 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:37.549484    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4","Type":"ContainerStarted","Data":"ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0"}
Oct 30 21:29:37.549741 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:37.549528    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4","Type":"ContainerStarted","Data":"37fe57b10bad64757103a4b8bc754721c5ebb415b0ab9d77e667341509330d0f"}
Oct 30 21:29:37.723453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:29:37.723389    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=2.723370231 podStartE2EDuration="2.723370231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:37.672808744 +0000 UTC m=+3152.628823521" watchObservedRunningTime="2026-10-30 21:29:37.723370231 +0000 UTC m=+3152.679385003"
Oct 30 21:29:45.671514 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:29:45.671425    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:30:05.660516 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:05.660477    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:05.661112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:05.660800    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" containerName="otc-container" containerID="cri-o://ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0" gracePeriod=30
Oct 30 21:30:06.134383 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.134357    5937 scope.go:122] "RemoveContainer" containerID="0cba8db0e2ceb8eeaf423a569ce9d8a8ff8d48e85e99cf198a6deb601eecbad5"
Oct 30 21:30:06.345346 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.345317    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"]
Oct 30 21:30:06.345669 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.345656    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5b7e38c5-4367-46de-8739-2bf413c4e3dc" containerName="ta-container"
Oct 30 21:30:06.345714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.345671    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b7e38c5-4367-46de-8739-2bf413c4e3dc" containerName="ta-container"
Oct 30 21:30:06.345763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.345754    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b7e38c5-4367-46de-8739-2bf413c4e3dc" containerName="ta-container"
Oct 30 21:30:06.350297 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.350282    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.387914 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.387857    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1fab9695-b9f8-4d45-b413-b97f88f7874a-ta-internal\") pod \"data-science-collector-targetallocator-6d9f49f66b-k2kth\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.387914 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.387894    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1fab9695-b9f8-4d45-b413-b97f88f7874a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d9f49f66b-k2kth\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.388079 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.387984    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ssxs\" (UniqueName: \"kubernetes.io/projected/1fab9695-b9f8-4d45-b413-b97f88f7874a-kube-api-access-5ssxs\") pod \"data-science-collector-targetallocator-6d9f49f66b-k2kth\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.407658 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.407635    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"]
Oct 30 21:30:06.489358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.489335    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1fab9695-b9f8-4d45-b413-b97f88f7874a-ta-internal\") pod \"data-science-collector-targetallocator-6d9f49f66b-k2kth\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.489491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.489368    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1fab9695-b9f8-4d45-b413-b97f88f7874a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d9f49f66b-k2kth\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.489491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.489408    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ssxs\" (UniqueName: \"kubernetes.io/projected/1fab9695-b9f8-4d45-b413-b97f88f7874a-kube-api-access-5ssxs\") pod \"data-science-collector-targetallocator-6d9f49f66b-k2kth\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.490059 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.489999    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1fab9695-b9f8-4d45-b413-b97f88f7874a-ta-internal\") pod \"data-science-collector-targetallocator-6d9f49f66b-k2kth\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.491996 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.491977    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1fab9695-b9f8-4d45-b413-b97f88f7874a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6d9f49f66b-k2kth\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.552186 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.552162    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ssxs\" (UniqueName: \"kubernetes.io/projected/1fab9695-b9f8-4d45-b413-b97f88f7874a-kube-api-access-5ssxs\") pod \"data-science-collector-targetallocator-6d9f49f66b-k2kth\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:06.661731 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:06.661669    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:07.037405 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:07.037376    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"]
Oct 30 21:30:07.039785 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:30:07.039761    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fab9695_b9f8_4d45_b413_b97f88f7874a.slice/crio-4e2dd3cc2f4648efa6da33bf64a83821e8bd50465e2d9c32ae5ac1dd718fe666 WatchSource:0}: Error finding container 4e2dd3cc2f4648efa6da33bf64a83821e8bd50465e2d9c32ae5ac1dd718fe666: Status 404 returned error can't find the container with id 4e2dd3cc2f4648efa6da33bf64a83821e8bd50465e2d9c32ae5ac1dd718fe666
Oct 30 21:30:07.042166 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:07.042136    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:30:07.042255 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:07.042192    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:30:07.694044 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:07.694011    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth" event={"ID":"1fab9695-b9f8-4d45-b413-b97f88f7874a","Type":"ContainerStarted","Data":"b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe"}
Oct 30 21:30:07.694044 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:07.694050    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth" event={"ID":"1fab9695-b9f8-4d45-b413-b97f88f7874a","Type":"ContainerStarted","Data":"4e2dd3cc2f4648efa6da33bf64a83821e8bd50465e2d9c32ae5ac1dd718fe666"}
Oct 30 21:30:07.694604 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:07.694162    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:07.694991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:07.694974    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth" podUID="1fab9695-b9f8-4d45-b413-b97f88f7874a" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.126:8080/readyz\": dial tcp 10.134.0.126:8080: connect: connection refused"
Oct 30 21:30:07.813926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:07.813884    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth" podStartSLOduration=1.813871023 podStartE2EDuration="1.813871023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:07.813046798 +0000 UTC m=+3182.769061574" watchObservedRunningTime="2026-10-30 21:30:07.813871023 +0000 UTC m=+3182.769885797"
Oct 30 21:30:08.014836 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.014804    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:08.104641 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.104613    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-kube-api-access-xhf6t\" (UniqueName: \"kubernetes.io/projected/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-kube-api-access-xhf6t\") pod \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") "
Oct 30 21:30:08.104792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.104659    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-monitoring-tls-certs\") pod \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") "
Oct 30 21:30:08.104792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.104683    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otlp-tls-certs\") pod \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") "
Oct 30 21:30:08.104792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.104712    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otc-internal\" (UniqueName: \"kubernetes.io/configmap/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otc-internal\") pod \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") "
Oct 30 21:30:08.104792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.104742    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-tls-certs\") pod \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") "
Oct 30 21:30:08.105017 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.104796    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-data-science-collector-ta-client-cert\") pod \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\" (UID: \"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4\") "
Oct 30 21:30:08.105179 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.105145    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otc-internal" pod "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" (UID: "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:08.107126 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.107079    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-monitoring-tls-certs" pod "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" (UID: "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:08.107126 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.107105    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-data-science-collector-ta-client-cert" pod "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" (UID: "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:08.107126 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.107118    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otlp-tls-certs" pod "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" (UID: "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:08.107368 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.107354    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-tls-certs" pod "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" (UID: "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:08.107426 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.107371    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-kube-api-access-xhf6t" pod "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" (UID: "5b9ec817-e0b0-46ef-900c-c0afdc4db2e4"). InnerVolumeSpecName "kube-api-access-xhf6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:08.205683 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.205656    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhf6t\" (UniqueName: \"kubernetes.io/projected/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-kube-api-access-xhf6t\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:08.205683 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.205681    5937 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-monitoring-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:08.205852 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.205692    5937 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otlp-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:08.205852 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.205700    5937 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-otc-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:08.205852 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.205708    5937 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:08.205852 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.205717    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4-data-science-collector-ta-client-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:08.699899 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.699862    5937 generic.go:356] "Generic (PLEG): container finished" podID="5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" containerID="ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0" exitCode=0
Oct 30 21:30:08.700305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.699910    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:08.700305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.699947    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4","Type":"ContainerDied","Data":"ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0"}
Oct 30 21:30:08.700305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.699997    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"5b9ec817-e0b0-46ef-900c-c0afdc4db2e4","Type":"ContainerDied","Data":"37fe57b10bad64757103a4b8bc754721c5ebb415b0ab9d77e667341509330d0f"}
Oct 30 21:30:08.700305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.700019    5937 scope.go:122] "RemoveContainer" containerID="ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0"
Oct 30 21:30:08.701697 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.701595    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:08.709832 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.709816    5937 scope.go:122] "RemoveContainer" containerID="ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0"
Oct 30 21:30:08.710103 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:08.710083    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0\": container with ID starting with ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0 not found: ID does not exist" containerID="ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0"
Oct 30 21:30:08.710195 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.710109    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0"} err="failed to get container status \"ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0\": rpc error: code = NotFound desc = could not find container \"ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0\": container with ID starting with ca70a956d843d820162b2b994c5907f9ad5695cc0ac3415c739818f904951dd0 not found: ID does not exist"
Oct 30 21:30:08.932741 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.932715    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"]
Oct 30 21:30:08.932908 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:08.932881    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs" podUID="817287a7-c4c3-4a46-b193-36ce122527ea" containerName="ta-container" containerID="cri-o://66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b" gracePeriod=30
Oct 30 21:30:09.015335 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.015303    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:09.019484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.019452    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:09.100464 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.100430    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:09.100816 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.100803    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" containerName="otc-container"
Oct 30 21:30:09.100874 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.100817    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" containerName="otc-container"
Oct 30 21:30:09.100910 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.100887    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" containerName="otc-container"
Oct 30 21:30:09.103817 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.103799    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.159825 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.159780    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:30:09.159825 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.159780    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:30:09.160034 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.159908    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-mpgx5\""
Oct 30 21:30:09.160034 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.159938    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:30:09.160034 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.159998    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:30:09.162332 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.162308    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b9ec817-e0b0-46ef-900c-c0afdc4db2e4" path="/var/lib/kubelet/pods/5b9ec817-e0b0-46ef-900c-c0afdc4db2e4/volumes"
Oct 30 21:30:09.165131 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.165109    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:30:09.170231 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.170211    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:09.188925 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.188905    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:30:09.214324 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.214296    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq95m\" (UniqueName: \"kubernetes.io/projected/54b51511-0a4f-4040-a11f-df90db2f4a6b-kube-api-access-wq95m\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.214432 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.214344    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.214493 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.214473    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.214587 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.214564    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.214646 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.214627    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/54b51511-0a4f-4040-a11f-df90db2f4a6b-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.214708 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.214667    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.315678 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.315650    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/817287a7-c4c3-4a46-b193-36ce122527ea-kube-api-access-2v4k8\" (UniqueName: \"kubernetes.io/projected/817287a7-c4c3-4a46-b193-36ce122527ea-kube-api-access-2v4k8\") pod \"817287a7-c4c3-4a46-b193-36ce122527ea\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") "
Oct 30 21:30:09.315804 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.315681    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/817287a7-c4c3-4a46-b193-36ce122527ea-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/817287a7-c4c3-4a46-b193-36ce122527ea-data-science-collector-ta-server-cert\") pod \"817287a7-c4c3-4a46-b193-36ce122527ea\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") "
Oct 30 21:30:09.315804 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.315704    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/817287a7-c4c3-4a46-b193-36ce122527ea-ta-internal\" (UniqueName: \"kubernetes.io/configmap/817287a7-c4c3-4a46-b193-36ce122527ea-ta-internal\") pod \"817287a7-c4c3-4a46-b193-36ce122527ea\" (UID: \"817287a7-c4c3-4a46-b193-36ce122527ea\") "
Oct 30 21:30:09.315933 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.315854    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/54b51511-0a4f-4040-a11f-df90db2f4a6b-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.315933 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.315884    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.315933 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.315922    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq95m\" (UniqueName: \"kubernetes.io/projected/54b51511-0a4f-4040-a11f-df90db2f4a6b-kube-api-access-wq95m\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.316092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.315943    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.316092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.316000    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.316729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.316028    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.316729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.316525    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/817287a7-c4c3-4a46-b193-36ce122527ea-ta-internal" pod "817287a7-c4c3-4a46-b193-36ce122527ea" (UID: "817287a7-c4c3-4a46-b193-36ce122527ea"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:09.318630 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.317568    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/54b51511-0a4f-4040-a11f-df90db2f4a6b-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.324004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.323979    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.325798 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.325773    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/817287a7-c4c3-4a46-b193-36ce122527ea-kube-api-access-2v4k8" pod "817287a7-c4c3-4a46-b193-36ce122527ea" (UID: "817287a7-c4c3-4a46-b193-36ce122527ea"). InnerVolumeSpecName "kube-api-access-2v4k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:09.326299 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.326259    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/817287a7-c4c3-4a46-b193-36ce122527ea-data-science-collector-ta-server-cert" pod "817287a7-c4c3-4a46-b193-36ce122527ea" (UID: "817287a7-c4c3-4a46-b193-36ce122527ea"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:09.327881 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.327856    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.328085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.328050    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.328289 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.328270    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.378844 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.378824    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq95m\" (UniqueName: \"kubernetes.io/projected/54b51511-0a4f-4040-a11f-df90db2f4a6b-kube-api-access-wq95m\") pod \"data-science-collector-collector-1\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.418373 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.418348    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v4k8\" (UniqueName: \"kubernetes.io/projected/817287a7-c4c3-4a46-b193-36ce122527ea-kube-api-access-2v4k8\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:09.418373 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.418370    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/817287a7-c4c3-4a46-b193-36ce122527ea-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:09.418510 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.418380    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/817287a7-c4c3-4a46-b193-36ce122527ea-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:09.419156 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.419142    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:09.706694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.706662    5937 generic.go:356] "Generic (PLEG): container finished" podID="817287a7-c4c3-4a46-b193-36ce122527ea" containerID="66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b" exitCode=0
Oct 30 21:30:09.707171 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.706729    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"
Oct 30 21:30:09.707171 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.706743    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs" event={"ID":"817287a7-c4c3-4a46-b193-36ce122527ea","Type":"ContainerDied","Data":"66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b"}
Oct 30 21:30:09.707171 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.706780    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs" event={"ID":"817287a7-c4c3-4a46-b193-36ce122527ea","Type":"ContainerDied","Data":"9c959aa8a3d4757d2be79fcf4b20d916b99aa1aae46614ea2b0b1f27854e3251"}
Oct 30 21:30:09.707171 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.706797    5937 scope.go:122] "RemoveContainer" containerID="66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b"
Oct 30 21:30:09.715620 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.715601    5937 scope.go:122] "RemoveContainer" containerID="66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b"
Oct 30 21:30:09.715857 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:09.715838    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b\": container with ID starting with 66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b not found: ID does not exist" containerID="66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b"
Oct 30 21:30:09.715906 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.715864    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b"} err="failed to get container status \"66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b\": rpc error: code = NotFound desc = could not find container \"66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b\": container with ID starting with 66b48a69cc43389be1d8a06393da4f591c977beddd4b0bac4043a97d9a3a329b not found: ID does not exist"
Oct 30 21:30:09.801061 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.801037    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:09.803385 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:30:09.803359    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b51511_0a4f_4040_a11f_df90db2f4a6b.slice/crio-45169697143bed93d8bf8641a8965870ed38e93e6cfe610154ebd2d5ed877775 WatchSource:0}: Error finding container 45169697143bed93d8bf8641a8965870ed38e93e6cfe610154ebd2d5ed877775: Status 404 returned error can't find the container with id 45169697143bed93d8bf8641a8965870ed38e93e6cfe610154ebd2d5ed877775
Oct 30 21:30:09.805580 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.805518    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:30:09.805682 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.805598    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:30:09.894068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.894045    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"]
Oct 30 21:30:09.900879 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:09.900857    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-57f8d466b9-9jrzs"]
Oct 30 21:30:10.714141 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:10.714103    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"54b51511-0a4f-4040-a11f-df90db2f4a6b","Type":"ContainerStarted","Data":"b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc"}
Oct 30 21:30:10.714566 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:10.714161    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"54b51511-0a4f-4040-a11f-df90db2f4a6b","Type":"ContainerStarted","Data":"45169697143bed93d8bf8641a8965870ed38e93e6cfe610154ebd2d5ed877775"}
Oct 30 21:30:10.835976 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:10.835923    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.835908639 podStartE2EDuration="1.835908639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:10.835212654 +0000 UTC m=+3185.791227431" watchObservedRunningTime="2026-10-30 21:30:10.835908639 +0000 UTC m=+3185.791923416"
Oct 30 21:30:11.160928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:11.160856    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="817287a7-c4c3-4a46-b193-36ce122527ea" path="/var/lib/kubelet/pods/817287a7-c4c3-4a46-b193-36ce122527ea/volumes"
Oct 30 21:30:15.671105 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:15.671061    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:30:25.218997 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.218964    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"]
Oct 30 21:30:25.219401 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.219163    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf" podUID="b25887a3-559c-44e6-897e-072ed1cc1d60" containerName="thanos-querier" containerID="cri-o://9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df" gracePeriod=30
Oct 30 21:30:25.474126 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.474073    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"
Oct 30 21:30:25.562271 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.562236    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b25887a3-559c-44e6-897e-072ed1cc1d60-kube-api-access-rcmgw\" (UniqueName: \"kubernetes.io/projected/b25887a3-559c-44e6-897e-072ed1cc1d60-kube-api-access-rcmgw\") pod \"b25887a3-559c-44e6-897e-072ed1cc1d60\" (UID: \"b25887a3-559c-44e6-897e-072ed1cc1d60\") "
Oct 30 21:30:25.564768 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.564723    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b25887a3-559c-44e6-897e-072ed1cc1d60-kube-api-access-rcmgw" pod "b25887a3-559c-44e6-897e-072ed1cc1d60" (UID: "b25887a3-559c-44e6-897e-072ed1cc1d60"). InnerVolumeSpecName "kube-api-access-rcmgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:25.663763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.663735    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcmgw\" (UniqueName: \"kubernetes.io/projected/b25887a3-559c-44e6-897e-072ed1cc1d60-kube-api-access-rcmgw\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:25.782734 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.782644    5937 generic.go:356] "Generic (PLEG): container finished" podID="b25887a3-559c-44e6-897e-072ed1cc1d60" containerID="9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df" exitCode=0
Oct 30 21:30:25.782734 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.782690    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"
Oct 30 21:30:25.782909 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.782730    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf" event={"ID":"b25887a3-559c-44e6-897e-072ed1cc1d60","Type":"ContainerDied","Data":"9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df"}
Oct 30 21:30:25.782909 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.782777    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf" event={"ID":"b25887a3-559c-44e6-897e-072ed1cc1d60","Type":"ContainerDied","Data":"c0118d8bd79c183f9a177677dcb8c437a4e63707eaee21469029655dcec267ca"}
Oct 30 21:30:25.782909 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.782794    5937 scope.go:122] "RemoveContainer" containerID="9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df"
Oct 30 21:30:25.792970 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.792942    5937 scope.go:122] "RemoveContainer" containerID="9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df"
Oct 30 21:30:25.793296 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:25.793273    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df\": container with ID starting with 9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df not found: ID does not exist" containerID="9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df"
Oct 30 21:30:25.793389 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.793310    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df"} err="failed to get container status \"9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df\": rpc error: code = NotFound desc = could not find container \"9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df\": container with ID starting with 9f7602093a6697165d1ced4192a5f5ffc968a89712cc58eb97cb18aabea004df not found: ID does not exist"
Oct 30 21:30:25.952169 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.952133    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"]
Oct 30 21:30:25.957288 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:25.957265    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-4z8kf"]
Oct 30 21:30:27.160867 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:27.160837    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b25887a3-559c-44e6-897e-072ed1cc1d60" path="/var/lib/kubelet/pods/b25887a3-559c-44e6-897e-072ed1cc1d60/volumes"
Oct 30 21:30:27.945266 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:27.945238    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:27.945452 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:27.945433    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="54b51511-0a4f-4040-a11f-df90db2f4a6b" containerName="otc-container" containerID="cri-o://b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc" gracePeriod=30
Oct 30 21:30:27.986383 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:27.986355    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"]
Oct 30 21:30:27.986626 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:27.986587    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth" podUID="1fab9695-b9f8-4d45-b413-b97f88f7874a" containerName="ta-container" containerID="cri-o://b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe" gracePeriod=30
Oct 30 21:30:28.239657 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.239634    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:28.258767 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.258748    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:28.280595 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.280567    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:30:28.280770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.280750    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="384f1893-2fd0-4372-98d8-95e983787427" containerName="perses" containerID="cri-o://5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d" gracePeriod=30
Oct 30 21:30:28.391594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.391558    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-data-science-collector-ta-client-cert\") pod \"54b51511-0a4f-4040-a11f-df90db2f4a6b\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") "
Oct 30 21:30:28.391770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.391605    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1fab9695-b9f8-4d45-b413-b97f88f7874a-ta-internal\" (UniqueName: \"kubernetes.io/configmap/1fab9695-b9f8-4d45-b413-b97f88f7874a-ta-internal\") pod \"1fab9695-b9f8-4d45-b413-b97f88f7874a\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") "
Oct 30 21:30:28.391770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.391631    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1fab9695-b9f8-4d45-b413-b97f88f7874a-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1fab9695-b9f8-4d45-b413-b97f88f7874a-data-science-collector-ta-server-cert\") pod \"1fab9695-b9f8-4d45-b413-b97f88f7874a\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") "
Oct 30 21:30:28.391770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.391654    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/54b51511-0a4f-4040-a11f-df90db2f4a6b-otc-internal\" (UniqueName: \"kubernetes.io/configmap/54b51511-0a4f-4040-a11f-df90db2f4a6b-otc-internal\") pod \"54b51511-0a4f-4040-a11f-df90db2f4a6b\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") "
Oct 30 21:30:28.391770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.391685    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1fab9695-b9f8-4d45-b413-b97f88f7874a-kube-api-access-5ssxs\" (UniqueName: \"kubernetes.io/projected/1fab9695-b9f8-4d45-b413-b97f88f7874a-kube-api-access-5ssxs\") pod \"1fab9695-b9f8-4d45-b413-b97f88f7874a\" (UID: \"1fab9695-b9f8-4d45-b413-b97f88f7874a\") "
Oct 30 21:30:28.392012 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.391971    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-monitoring-tls-certs\") pod \"54b51511-0a4f-4040-a11f-df90db2f4a6b\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") "
Oct 30 21:30:28.392076 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.392045    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fab9695-b9f8-4d45-b413-b97f88f7874a-ta-internal" pod "1fab9695-b9f8-4d45-b413-b97f88f7874a" (UID: "1fab9695-b9f8-4d45-b413-b97f88f7874a"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:28.392134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.392106    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/54b51511-0a4f-4040-a11f-df90db2f4a6b-kube-api-access-wq95m\" (UniqueName: \"kubernetes.io/projected/54b51511-0a4f-4040-a11f-df90db2f4a6b-kube-api-access-wq95m\") pod \"54b51511-0a4f-4040-a11f-df90db2f4a6b\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") "
Oct 30 21:30:28.392197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.392155    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-tls-certs\") pod \"54b51511-0a4f-4040-a11f-df90db2f4a6b\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") "
Oct 30 21:30:28.392197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.392182    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-otlp-tls-certs\") pod \"54b51511-0a4f-4040-a11f-df90db2f4a6b\" (UID: \"54b51511-0a4f-4040-a11f-df90db2f4a6b\") "
Oct 30 21:30:28.393045 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.392478    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/1fab9695-b9f8-4d45-b413-b97f88f7874a-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.393045 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.392773    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54b51511-0a4f-4040-a11f-df90db2f4a6b-otc-internal" pod "54b51511-0a4f-4040-a11f-df90db2f4a6b" (UID: "54b51511-0a4f-4040-a11f-df90db2f4a6b"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:28.394843 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.394817    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-data-science-collector-ta-client-cert" pod "54b51511-0a4f-4040-a11f-df90db2f4a6b" (UID: "54b51511-0a4f-4040-a11f-df90db2f4a6b"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:28.395048 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.395023    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b51511-0a4f-4040-a11f-df90db2f4a6b-kube-api-access-wq95m" pod "54b51511-0a4f-4040-a11f-df90db2f4a6b" (UID: "54b51511-0a4f-4040-a11f-df90db2f4a6b"). InnerVolumeSpecName "kube-api-access-wq95m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:28.395190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.395170    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-otlp-tls-certs" pod "54b51511-0a4f-4040-a11f-df90db2f4a6b" (UID: "54b51511-0a4f-4040-a11f-df90db2f4a6b"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:28.396006 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.395972    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fab9695-b9f8-4d45-b413-b97f88f7874a-data-science-collector-ta-server-cert" pod "1fab9695-b9f8-4d45-b413-b97f88f7874a" (UID: "1fab9695-b9f8-4d45-b413-b97f88f7874a"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:28.396087 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.396003    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-tls-certs" pod "54b51511-0a4f-4040-a11f-df90db2f4a6b" (UID: "54b51511-0a4f-4040-a11f-df90db2f4a6b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:28.396229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.396087    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fab9695-b9f8-4d45-b413-b97f88f7874a-kube-api-access-5ssxs" pod "1fab9695-b9f8-4d45-b413-b97f88f7874a" (UID: "1fab9695-b9f8-4d45-b413-b97f88f7874a"). InnerVolumeSpecName "kube-api-access-5ssxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:28.396348 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.396301    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-monitoring-tls-certs" pod "54b51511-0a4f-4040-a11f-df90db2f4a6b" (UID: "54b51511-0a4f-4040-a11f-df90db2f4a6b"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:30:28.493115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.493034    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ssxs\" (UniqueName: \"kubernetes.io/projected/1fab9695-b9f8-4d45-b413-b97f88f7874a-kube-api-access-5ssxs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.493115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.493071    5937 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-monitoring-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.493115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.493086    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq95m\" (UniqueName: \"kubernetes.io/projected/54b51511-0a4f-4040-a11f-df90db2f4a6b-kube-api-access-wq95m\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.493115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.493101    5937 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.493115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.493115    5937 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-otlp-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.493369 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.493129    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/54b51511-0a4f-4040-a11f-df90db2f4a6b-data-science-collector-ta-client-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.493369 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.493147    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/1fab9695-b9f8-4d45-b413-b97f88f7874a-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.493369 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.493161    5937 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/54b51511-0a4f-4040-a11f-df90db2f4a6b-otc-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.516396 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.516370    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:28.694687 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.694658    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/384f1893-2fd0-4372-98d8-95e983787427-plugins\" (UniqueName: \"kubernetes.io/empty-dir/384f1893-2fd0-4372-98d8-95e983787427-plugins\") pod \"384f1893-2fd0-4372-98d8-95e983787427\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") "
Oct 30 21:30:28.694858 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.694706    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/384f1893-2fd0-4372-98d8-95e983787427-config\" (UniqueName: \"kubernetes.io/configmap/384f1893-2fd0-4372-98d8-95e983787427-config\") pod \"384f1893-2fd0-4372-98d8-95e983787427\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") "
Oct 30 21:30:28.694858 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.694729    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/384f1893-2fd0-4372-98d8-95e983787427-kube-api-access-5222s\" (UniqueName: \"kubernetes.io/projected/384f1893-2fd0-4372-98d8-95e983787427-kube-api-access-5222s\") pod \"384f1893-2fd0-4372-98d8-95e983787427\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") "
Oct 30 21:30:28.694858 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.694853    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"384f1893-2fd0-4372-98d8-95e983787427\" (UID: \"384f1893-2fd0-4372-98d8-95e983787427\") "
Oct 30 21:30:28.695083 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.695060    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/384f1893-2fd0-4372-98d8-95e983787427-config" pod "384f1893-2fd0-4372-98d8-95e983787427" (UID: "384f1893-2fd0-4372-98d8-95e983787427"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:28.697222 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.697189    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/384f1893-2fd0-4372-98d8-95e983787427-kube-api-access-5222s" pod "384f1893-2fd0-4372-98d8-95e983787427" (UID: "384f1893-2fd0-4372-98d8-95e983787427"). InnerVolumeSpecName "kube-api-access-5222s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:28.697903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.697882    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "384f1893-2fd0-4372-98d8-95e983787427" (UID: "384f1893-2fd0-4372-98d8-95e983787427"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:30:28.795828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.795732    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:30:28.795828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.795782    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/384f1893-2fd0-4372-98d8-95e983787427-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.795828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.795798    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5222s\" (UniqueName: \"kubernetes.io/projected/384f1893-2fd0-4372-98d8-95e983787427-kube-api-access-5222s\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.799578 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.799378    5937 generic.go:356] "Generic (PLEG): container finished" podID="54b51511-0a4f-4040-a11f-df90db2f4a6b" containerID="b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc" exitCode=0
Oct 30 21:30:28.799578 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.799420    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"54b51511-0a4f-4040-a11f-df90db2f4a6b","Type":"ContainerDied","Data":"b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc"}
Oct 30 21:30:28.799578 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.799473    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:28.799578 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.799496    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"54b51511-0a4f-4040-a11f-df90db2f4a6b","Type":"ContainerDied","Data":"45169697143bed93d8bf8641a8965870ed38e93e6cfe610154ebd2d5ed877775"}
Oct 30 21:30:28.799578 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.799529    5937 scope.go:122] "RemoveContainer" containerID="b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc"
Oct 30 21:30:28.800957 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.800932    5937 generic.go:356] "Generic (PLEG): container finished" podID="384f1893-2fd0-4372-98d8-95e983787427" containerID="5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d" exitCode=0
Oct 30 21:30:28.801036 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.801009    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"384f1893-2fd0-4372-98d8-95e983787427","Type":"ContainerDied","Data":"5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d"}
Oct 30 21:30:28.801095 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.801038    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"384f1893-2fd0-4372-98d8-95e983787427","Type":"ContainerDied","Data":"65c8880e354ab1745fc0989ac5df7c551754a235c356c196c67678e6862402b4"}
Oct 30 21:30:28.801095 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.801013    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:28.802904 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.802883    5937 generic.go:356] "Generic (PLEG): container finished" podID="1fab9695-b9f8-4d45-b413-b97f88f7874a" containerID="b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe" exitCode=0
Oct 30 21:30:28.803016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.802917    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"
Oct 30 21:30:28.803016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.802996    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth" event={"ID":"1fab9695-b9f8-4d45-b413-b97f88f7874a","Type":"ContainerDied","Data":"b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe"}
Oct 30 21:30:28.803110 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.803027    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth" event={"ID":"1fab9695-b9f8-4d45-b413-b97f88f7874a","Type":"ContainerDied","Data":"4e2dd3cc2f4648efa6da33bf64a83821e8bd50465e2d9c32ae5ac1dd718fe666"}
Oct 30 21:30:28.811074 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.811034    5937 scope.go:122] "RemoveContainer" containerID="b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc"
Oct 30 21:30:28.811433 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.811416    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:30:28.811816 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:28.811518    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc\": container with ID starting with b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc not found: ID does not exist" containerID="b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc"
Oct 30 21:30:28.811816 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.811648    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc"} err="failed to get container status \"b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc\": rpc error: code = NotFound desc = could not find container \"b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc\": container with ID starting with b83720237ec8fbacaa49b8223e8f59e3da6569cbfd355d7b4ffdfb8ee8ddbdbc not found: ID does not exist"
Oct 30 21:30:28.811816 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.811672    5937 scope.go:122] "RemoveContainer" containerID="5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d"
Oct 30 21:30:28.822611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.822593    5937 scope.go:122] "RemoveContainer" containerID="5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d"
Oct 30 21:30:28.822873 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:28.822848    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d\": container with ID starting with 5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d not found: ID does not exist" containerID="5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d"
Oct 30 21:30:28.822946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.822878    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d"} err="failed to get container status \"5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d\": rpc error: code = NotFound desc = could not find container \"5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d\": container with ID starting with 5f39a60cd519aa4fa4f005a68e2cea5fe819c20f15fa4f09db7a84c726e1d96d not found: ID does not exist"
Oct 30 21:30:28.822946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.822893    5937 scope.go:122] "RemoveContainer" containerID="b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe"
Oct 30 21:30:28.830463 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.830446    5937 scope.go:122] "RemoveContainer" containerID="b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe"
Oct 30 21:30:28.830744 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:28.830727    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe\": container with ID starting with b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe not found: ID does not exist" containerID="b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe"
Oct 30 21:30:28.830839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.830752    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe"} err="failed to get container status \"b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe\": rpc error: code = NotFound desc = could not find container \"b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe\": container with ID starting with b0a03e1b57e7981c19ce9cd04372ae8ed60dbccae683bf8e0c400364d88cebfe not found: ID does not exist"
Oct 30 21:30:28.852164 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.852139    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/384f1893-2fd0-4372-98d8-95e983787427-plugins" pod "384f1893-2fd0-4372-98d8-95e983787427" (UID: "384f1893-2fd0-4372-98d8-95e983787427"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:30:28.896704 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.896683    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:30:28.896786 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.896720    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/384f1893-2fd0-4372-98d8-95e983787427-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:28.965358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.965336    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"]
Oct 30 21:30:28.969697 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:28.969668    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6d9f49f66b-k2kth"]
Oct 30 21:30:29.134600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:29.134579    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:29.138709 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:29.138688    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:29.160197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:29.160171    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1fab9695-b9f8-4d45-b413-b97f88f7874a" path="/var/lib/kubelet/pods/1fab9695-b9f8-4d45-b413-b97f88f7874a/volumes"
Oct 30 21:30:29.160525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:29.160513    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="54b51511-0a4f-4040-a11f-df90db2f4a6b" path="/var/lib/kubelet/pods/54b51511-0a4f-4040-a11f-df90db2f4a6b/volumes"
Oct 30 21:30:29.249779 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:29.249750    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:30:29.254059 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:29.254041    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:30:31.160936 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:31.160908    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="384f1893-2fd0-4372-98d8-95e983787427" path="/var/lib/kubelet/pods/384f1893-2fd0-4372-98d8-95e983787427/volumes"
Oct 30 21:30:45.671170 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:45.671132    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:30:45.797770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.797738    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"]
Oct 30 21:30:45.798123 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798103    5937 cpu_manager.go:414] "containerMap: removing container" podUID="817287a7-c4c3-4a46-b193-36ce122527ea" containerName="ta-container"
Oct 30 21:30:45.798123 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798120    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="817287a7-c4c3-4a46-b193-36ce122527ea" containerName="ta-container"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798133    5937 cpu_manager.go:414] "containerMap: removing container" podUID="b25887a3-559c-44e6-897e-072ed1cc1d60" containerName="thanos-querier"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798138    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b25887a3-559c-44e6-897e-072ed1cc1d60" containerName="thanos-querier"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798145    5937 cpu_manager.go:414] "containerMap: removing container" podUID="54b51511-0a4f-4040-a11f-df90db2f4a6b" containerName="otc-container"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798149    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="54b51511-0a4f-4040-a11f-df90db2f4a6b" containerName="otc-container"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798165    5937 cpu_manager.go:414] "containerMap: removing container" podUID="1fab9695-b9f8-4d45-b413-b97f88f7874a" containerName="ta-container"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798169    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1fab9695-b9f8-4d45-b413-b97f88f7874a" containerName="ta-container"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798189    5937 cpu_manager.go:414] "containerMap: removing container" podUID="384f1893-2fd0-4372-98d8-95e983787427" containerName="perses"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798193    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="384f1893-2fd0-4372-98d8-95e983787427" containerName="perses"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798244    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="384f1893-2fd0-4372-98d8-95e983787427" containerName="perses"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798253    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="817287a7-c4c3-4a46-b193-36ce122527ea" containerName="ta-container"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798258    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="b25887a3-559c-44e6-897e-072ed1cc1d60" containerName="thanos-querier"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798263    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="54b51511-0a4f-4040-a11f-df90db2f4a6b" containerName="otc-container"
Oct 30 21:30:45.798292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.798270    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="1fab9695-b9f8-4d45-b413-b97f88f7874a" containerName="ta-container"
Oct 30 21:30:45.801363 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.801341    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"
Oct 30 21:30:45.826430 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.826408    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j48gq\" (UniqueName: \"kubernetes.io/projected/6607a87c-c71a-40a0-b7df-053b575ff925-kube-api-access-j48gq\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp\" (UID: \"6607a87c-c71a-40a0-b7df-053b575ff925\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"
Oct 30 21:30:45.908510 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.908486    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:30:45.908724 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.908709    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:30:45.908777 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.908746    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:30:45.909491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.909470    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"]
Oct 30 21:30:45.927404 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.927344    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j48gq\" (UniqueName: \"kubernetes.io/projected/6607a87c-c71a-40a0-b7df-053b575ff925-kube-api-access-j48gq\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp\" (UID: \"6607a87c-c71a-40a0-b7df-053b575ff925\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"
Oct 30 21:30:45.989945 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:45.989914    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j48gq\" (UniqueName: \"kubernetes.io/projected/6607a87c-c71a-40a0-b7df-053b575ff925-kube-api-access-j48gq\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp\" (UID: \"6607a87c-c71a-40a0-b7df-053b575ff925\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"
Oct 30 21:30:46.113283 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:46.113252    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"
Oct 30 21:30:46.485816 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:46.485789    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"]
Oct 30 21:30:46.488706 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:30:46.488680    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6607a87c_c71a_40a0_b7df_053b575ff925.slice/crio-f1cfb63cb1b7c56d625242aa26a33efc88810a21e379d82700afe5e712825bc8 WatchSource:0}: Error finding container f1cfb63cb1b7c56d625242aa26a33efc88810a21e379d82700afe5e712825bc8: Status 404 returned error can't find the container with id f1cfb63cb1b7c56d625242aa26a33efc88810a21e379d82700afe5e712825bc8
Oct 30 21:30:46.892213 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:46.892124    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp" event={"ID":"6607a87c-c71a-40a0-b7df-053b575ff925","Type":"ContainerStarted","Data":"a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee"}
Oct 30 21:30:46.892213 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:46.892170    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp" event={"ID":"6607a87c-c71a-40a0-b7df-053b575ff925","Type":"ContainerStarted","Data":"f1cfb63cb1b7c56d625242aa26a33efc88810a21e379d82700afe5e712825bc8"}
Oct 30 21:30:48.992208 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:48.992161    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp" podStartSLOduration=3.99214568 podStartE2EDuration="3.99214568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:47.008726905 +0000 UTC m=+3221.964741681" watchObservedRunningTime="2026-10-30 21:30:48.99214568 +0000 UTC m=+3223.948160489"
Oct 30 21:30:48.992616 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:48.992389    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:48.995800 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:48.995780    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.048864 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.048835    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wg7d\" (UniqueName: \"kubernetes.io/projected/055fe7a1-09b3-4552-84b4-f106d701ff10-kube-api-access-8wg7d\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.049022 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.048889    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.049022 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.048983    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.049022 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.049013    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.049187 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.049042    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.049187 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.049098    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/055fe7a1-09b3-4552-84b4-f106d701ff10-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.057486 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.057454    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:49.091773 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.091750    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:30:49.095013 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.094999    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.100418 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.100397    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:30:49.100555 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.100463    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:30:49.100555 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.100481    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:30:49.107286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.107269    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-9267g\""
Oct 30 21:30:49.107563 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.107523    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:30:49.107563 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.107527    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:30:49.149576 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.149533    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.149674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.149582    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.149674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.149605    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.149674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.149623    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/055fe7a1-09b3-4552-84b4-f106d701ff10-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.149674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.149661    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wg7d\" (UniqueName: \"kubernetes.io/projected/055fe7a1-09b3-4552-84b4-f106d701ff10-kube-api-access-8wg7d\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.149863 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.149698    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.149863 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:49.149789    5937 secret.go:189] Couldn't get secret redhat-ods-monitoring/data-science-collector-collector-headless-tls: secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:30:49.149863 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:30:49.149836    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs podName:055fe7a1-09b3-4552-84b4-f106d701ff10 nodeName:}" failed. No retries permitted until 2026-10-30 21:30:49.649822595 +0000 UTC m=+3224.605837362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "otlp-tls-certs" (UniqueName: "kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs") pod "data-science-collector-collector-1" (UID: "055fe7a1-09b3-4552-84b4-f106d701ff10") : secret "data-science-collector-collector-headless-tls" not found
Oct 30 21:30:49.150444 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.150357    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/055fe7a1-09b3-4552-84b4-f106d701ff10-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.152766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.152723    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.152991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.152964    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.153115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.152962    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.153115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.153105    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:30:49.194701 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.194680    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:30:49.216922 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.216895    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wg7d\" (UniqueName: \"kubernetes.io/projected/055fe7a1-09b3-4552-84b4-f106d701ff10-kube-api-access-8wg7d\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.284942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.284880    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"]
Oct 30 21:30:49.291715 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.291695    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.346110 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.346053    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:30:49.346110 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.346054    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-2tdsx\""
Oct 30 21:30:49.346385 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.346137    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:30:49.347083 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.347064    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"]
Oct 30 21:30:49.351360 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.351336    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/73e6ed46-cea0-4ee5-b240-36c135adab49-plugins\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.351460 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.351393    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73e6ed46-cea0-4ee5-b240-36c135adab49-config\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.351596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.351578    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99sfq\" (UniqueName: \"kubernetes.io/projected/73e6ed46-cea0-4ee5-b240-36c135adab49-kube-api-access-99sfq\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.452860 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.452830    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73e6ed46-cea0-4ee5-b240-36c135adab49-config\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.453030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.452870    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-ta-internal\") pod \"data-science-collector-targetallocator-f45b45d6c-fdzq5\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.453030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.452910    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f45b45d6c-fdzq5\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.453030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.452944    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99sfq\" (UniqueName: \"kubernetes.io/projected/73e6ed46-cea0-4ee5-b240-36c135adab49-kube-api-access-99sfq\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.453198 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.453107    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-966ls\" (UniqueName: \"kubernetes.io/projected/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-kube-api-access-966ls\") pod \"data-science-collector-targetallocator-f45b45d6c-fdzq5\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.453198 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.453131    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/73e6ed46-cea0-4ee5-b240-36c135adab49-plugins\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.453409 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.453394    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/73e6ed46-cea0-4ee5-b240-36c135adab49-plugins\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.453499 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.453482    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73e6ed46-cea0-4ee5-b240-36c135adab49-config\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.516068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.516040    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99sfq\" (UniqueName: \"kubernetes.io/projected/73e6ed46-cea0-4ee5-b240-36c135adab49-kube-api-access-99sfq\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:49.554108 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.554051    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-ta-internal\") pod \"data-science-collector-targetallocator-f45b45d6c-fdzq5\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.554108 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.554101    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f45b45d6c-fdzq5\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.554245 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.554149    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-966ls\" (UniqueName: \"kubernetes.io/projected/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-kube-api-access-966ls\") pod \"data-science-collector-targetallocator-f45b45d6c-fdzq5\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.554780 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.554756    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-ta-internal\") pod \"data-science-collector-targetallocator-f45b45d6c-fdzq5\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.556477 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.556459    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f45b45d6c-fdzq5\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.616083 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.616058    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-966ls\" (UniqueName: \"kubernetes.io/projected/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-kube-api-access-966ls\") pod \"data-science-collector-targetallocator-f45b45d6c-fdzq5\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.655137 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.655114    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.657290 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.657267    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:49.902775 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.902703    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:49.908192 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:49.908165    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:30:50.280582 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.280413    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"]
Oct 30 21:30:50.282737 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:30:50.282710    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod725b6fe6_eafa_445e_85d7_d4ab4ef15c99.slice/crio-493a99f9218390b5707678acc30c567c15e9fb1305a6594ab42a65089e607547 WatchSource:0}: Error finding container 493a99f9218390b5707678acc30c567c15e9fb1305a6594ab42a65089e607547: Status 404 returned error can't find the container with id 493a99f9218390b5707678acc30c567c15e9fb1305a6594ab42a65089e607547
Oct 30 21:30:50.285150 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.285122    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:30:50.285220 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.285178    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:30:50.332246 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.332219    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:30:50.349624 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:30:50.349601    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055fe7a1_09b3_4552_84b4_f106d701ff10.slice/crio-c24d3ca194a2a5dc5741ea8fda280fc0b9049d7fa467179b8e370ec0e71df3d1 WatchSource:0}: Error finding container c24d3ca194a2a5dc5741ea8fda280fc0b9049d7fa467179b8e370ec0e71df3d1: Status 404 returned error can't find the container with id c24d3ca194a2a5dc5741ea8fda280fc0b9049d7fa467179b8e370ec0e71df3d1
Oct 30 21:30:50.352069 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.352035    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:30:50.352140 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.352117    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:30:50.921339 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.921241    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"055fe7a1-09b3-4552-84b4-f106d701ff10","Type":"ContainerStarted","Data":"488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663"}
Oct 30 21:30:50.921513 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.921340    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"055fe7a1-09b3-4552-84b4-f106d701ff10","Type":"ContainerStarted","Data":"c24d3ca194a2a5dc5741ea8fda280fc0b9049d7fa467179b8e370ec0e71df3d1"}
Oct 30 21:30:50.922928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.922901    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5" event={"ID":"725b6fe6-eafa-445e-85d7-d4ab4ef15c99","Type":"ContainerStarted","Data":"6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0"}
Oct 30 21:30:50.923064 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.922933    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5" event={"ID":"725b6fe6-eafa-445e-85d7-d4ab4ef15c99","Type":"ContainerStarted","Data":"493a99f9218390b5707678acc30c567c15e9fb1305a6594ab42a65089e607547"}
Oct 30 21:30:50.923151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.923133    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:50.924005 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:50.923981    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5" podUID="725b6fe6-eafa-445e-85d7-d4ab4ef15c99" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.131:8080/readyz\": dial tcp 10.134.0.131:8080: connect: connection refused"
Oct 30 21:30:51.042236 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:51.042181    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=3.042168375 podStartE2EDuration="3.042168375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:51.041420881 +0000 UTC m=+3225.997435656" watchObservedRunningTime="2026-10-30 21:30:51.042168375 +0000 UTC m=+3225.998183154"
Oct 30 21:30:51.163221 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:51.163174    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5" podStartSLOduration=2.163161367 podStartE2EDuration="2.163161367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:51.162867009 +0000 UTC m=+3226.118881787" watchObservedRunningTime="2026-10-30 21:30:51.163161367 +0000 UTC m=+3226.119176142"
Oct 30 21:30:51.928375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:51.928350    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:30:54.397443 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:54.397406    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:54.504656 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:54.504627    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:54.599892 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:54.599863    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:54.600029 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:54.599989    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:54.654894 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:54.654841    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:54.795332 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:54.795304    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:54.864270 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:54.864244    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:55.106480 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:55.106448    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:55.479219 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:55.479185    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:30:55.481850 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:30:55.481818    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73e6ed46_cea0_4ee5_b240_36c135adab49.slice/crio-52e8eacd4d2329a3623eb48e230349728e910e26bc622aad04c88c2583fb951c WatchSource:0}: Error finding container 52e8eacd4d2329a3623eb48e230349728e910e26bc622aad04c88c2583fb951c: Status 404 returned error can't find the container with id 52e8eacd4d2329a3623eb48e230349728e910e26bc622aad04c88c2583fb951c
Oct 30 21:30:55.947903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:55.947811    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"73e6ed46-cea0-4ee5-b240-36c135adab49","Type":"ContainerStarted","Data":"8efdcd610c0cf27bc705432bb509409daa78eb70c866a9af6b6ba777230c5961"}
Oct 30 21:30:55.947903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:55.947862    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"73e6ed46-cea0-4ee5-b240-36c135adab49","Type":"ContainerStarted","Data":"52e8eacd4d2329a3623eb48e230349728e910e26bc622aad04c88c2583fb951c"}
Oct 30 21:30:55.948135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:55.947919    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:30:56.066949 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:30:56.066895    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=7.066878816 podStartE2EDuration="7.066878816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:30:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:56.066680919 +0000 UTC m=+3231.022695696" watchObservedRunningTime="2026-10-30 21:30:56.066878816 +0000 UTC m=+3231.022893589"
Oct 30 21:31:00.939905 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:00.939876    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"]
Oct 30 21:31:00.962652 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:00.962624    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"
Oct 30 21:31:01.000361 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:01.000332    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"]
Oct 30 21:31:01.055229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:01.055206    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8n9g\" (UniqueName: \"kubernetes.io/projected/14268376-5fa4-4e26-a55e-aeae74e0b033-kube-api-access-d8n9g\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x\" (UID: \"14268376-5fa4-4e26-a55e-aeae74e0b033\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"
Oct 30 21:31:01.156279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:01.156253    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8n9g\" (UniqueName: \"kubernetes.io/projected/14268376-5fa4-4e26-a55e-aeae74e0b033-kube-api-access-d8n9g\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x\" (UID: \"14268376-5fa4-4e26-a55e-aeae74e0b033\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"
Oct 30 21:31:01.218409 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:01.218386    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8n9g\" (UniqueName: \"kubernetes.io/projected/14268376-5fa4-4e26-a55e-aeae74e0b033-kube-api-access-d8n9g\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x\" (UID: \"14268376-5fa4-4e26-a55e-aeae74e0b033\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"
Oct 30 21:31:01.277366 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:01.277336    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"
Oct 30 21:31:01.648118 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:01.648095    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"]
Oct 30 21:31:01.650925 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:31:01.650896    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14268376_5fa4_4e26_a55e_aeae74e0b033.slice/crio-8be7eb2389cd6d5da5bb0c33fafe19d042a083a0031bb5c4c5975c0a438049b5 WatchSource:0}: Error finding container 8be7eb2389cd6d5da5bb0c33fafe19d042a083a0031bb5c4c5975c0a438049b5: Status 404 returned error can't find the container with id 8be7eb2389cd6d5da5bb0c33fafe19d042a083a0031bb5c4c5975c0a438049b5
Oct 30 21:31:01.976776 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:01.976745    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x" event={"ID":"14268376-5fa4-4e26-a55e-aeae74e0b033","Type":"ContainerStarted","Data":"09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330"}
Oct 30 21:31:01.977160 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:01.976785    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x" event={"ID":"14268376-5fa4-4e26-a55e-aeae74e0b033","Type":"ContainerStarted","Data":"8be7eb2389cd6d5da5bb0c33fafe19d042a083a0031bb5c4c5975c0a438049b5"}
Oct 30 21:31:02.093642 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.093588    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x" podStartSLOduration=2.093573848 podStartE2EDuration="2.093573848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:02.09329145 +0000 UTC m=+3237.049306228" watchObservedRunningTime="2026-10-30 21:31:02.093573848 +0000 UTC m=+3237.049588677"
Oct 30 21:31:02.118947 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.118908    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"]
Oct 30 21:31:02.119130 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.119090    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp" podUID="6607a87c-c71a-40a0-b7df-053b575ff925" containerName="thanos-querier" containerID="cri-o://a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee" gracePeriod=30
Oct 30 21:31:02.368780 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.368755    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"
Oct 30 21:31:02.467853 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.467816    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6607a87c-c71a-40a0-b7df-053b575ff925-kube-api-access-j48gq\" (UniqueName: \"kubernetes.io/projected/6607a87c-c71a-40a0-b7df-053b575ff925-kube-api-access-j48gq\") pod \"6607a87c-c71a-40a0-b7df-053b575ff925\" (UID: \"6607a87c-c71a-40a0-b7df-053b575ff925\") "
Oct 30 21:31:02.470035 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.470005    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6607a87c-c71a-40a0-b7df-053b575ff925-kube-api-access-j48gq" pod "6607a87c-c71a-40a0-b7df-053b575ff925" (UID: "6607a87c-c71a-40a0-b7df-053b575ff925"). InnerVolumeSpecName "kube-api-access-j48gq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:31:02.569088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.569024    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j48gq\" (UniqueName: \"kubernetes.io/projected/6607a87c-c71a-40a0-b7df-053b575ff925-kube-api-access-j48gq\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:31:02.982325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.982294    5937 generic.go:356] "Generic (PLEG): container finished" podID="6607a87c-c71a-40a0-b7df-053b575ff925" containerID="a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee" exitCode=0
Oct 30 21:31:02.982860 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.982336    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"
Oct 30 21:31:02.982860 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.982376    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp" event={"ID":"6607a87c-c71a-40a0-b7df-053b575ff925","Type":"ContainerDied","Data":"a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee"}
Oct 30 21:31:02.982860 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.982414    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp" event={"ID":"6607a87c-c71a-40a0-b7df-053b575ff925","Type":"ContainerDied","Data":"f1cfb63cb1b7c56d625242aa26a33efc88810a21e379d82700afe5e712825bc8"}
Oct 30 21:31:02.982860 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.982431    5937 scope.go:122] "RemoveContainer" containerID="a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee"
Oct 30 21:31:02.996829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.996806    5937 scope.go:122] "RemoveContainer" containerID="a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee"
Oct 30 21:31:02.997165 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:31:02.997146    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee\": container with ID starting with a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee not found: ID does not exist" containerID="a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee"
Oct 30 21:31:02.997237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:02.997173    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee"} err="failed to get container status \"a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee\": rpc error: code = NotFound desc = could not find container \"a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee\": container with ID starting with a0e950257407424865aac30d58035e6263ddcda17bcdd0cbf3dc1c90e3e581ee not found: ID does not exist"
Oct 30 21:31:03.148505 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:03.148476    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"]
Oct 30 21:31:03.150473 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:03.150450    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-g7xbp"]
Oct 30 21:31:03.161266 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:03.161245    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6607a87c-c71a-40a0-b7df-053b575ff925" path="/var/lib/kubelet/pods/6607a87c-c71a-40a0-b7df-053b575ff925/volumes"
Oct 30 21:31:06.955619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:06.955589    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:31:15.672601 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:31:15.672504    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:31:42.769857 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:42.769820    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"]
Oct 30 21:31:42.770316 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:42.770211    5937 cpu_manager.go:414] "containerMap: removing container" podUID="6607a87c-c71a-40a0-b7df-053b575ff925" containerName="thanos-querier"
Oct 30 21:31:42.770316 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:42.770228    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6607a87c-c71a-40a0-b7df-053b575ff925" containerName="thanos-querier"
Oct 30 21:31:42.770316 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:42.770313    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="6607a87c-c71a-40a0-b7df-053b575ff925" containerName="thanos-querier"
Oct 30 21:31:42.773438 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:42.773419    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:42.881371 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:42.881343    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"]
Oct 30 21:31:42.901424 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:42.901399    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ec39432-edd3-4b69-9c57-45bcfc16c602-ta-internal\") pod \"data-science-collector-targetallocator-6cf7bbd4b7-mvh9c\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:42.901548 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:42.901439    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg4sc\" (UniqueName: \"kubernetes.io/projected/5ec39432-edd3-4b69-9c57-45bcfc16c602-kube-api-access-kg4sc\") pod \"data-science-collector-targetallocator-6cf7bbd4b7-mvh9c\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:42.901548 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:42.901511    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ec39432-edd3-4b69-9c57-45bcfc16c602-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6cf7bbd4b7-mvh9c\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:43.002961 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.002923    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ec39432-edd3-4b69-9c57-45bcfc16c602-ta-internal\") pod \"data-science-collector-targetallocator-6cf7bbd4b7-mvh9c\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:43.003160 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.002971    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg4sc\" (UniqueName: \"kubernetes.io/projected/5ec39432-edd3-4b69-9c57-45bcfc16c602-kube-api-access-kg4sc\") pod \"data-science-collector-targetallocator-6cf7bbd4b7-mvh9c\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:43.003160 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.002995    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ec39432-edd3-4b69-9c57-45bcfc16c602-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6cf7bbd4b7-mvh9c\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:43.003650 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.003626    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ec39432-edd3-4b69-9c57-45bcfc16c602-ta-internal\") pod \"data-science-collector-targetallocator-6cf7bbd4b7-mvh9c\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:43.005629 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.005608    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ec39432-edd3-4b69-9c57-45bcfc16c602-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6cf7bbd4b7-mvh9c\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:43.066488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.066421    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg4sc\" (UniqueName: \"kubernetes.io/projected/5ec39432-edd3-4b69-9c57-45bcfc16c602-kube-api-access-kg4sc\") pod \"data-science-collector-targetallocator-6cf7bbd4b7-mvh9c\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:43.085279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.085253    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:43.460962 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.460926    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"]
Oct 30 21:31:43.465133 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:31:43.465104    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ec39432_edd3_4b69_9c57_45bcfc16c602.slice/crio-d821b4fdf29197897a9955f640fe2ad3d8e39691592138a5d21da2ab61474d86 WatchSource:0}: Error finding container d821b4fdf29197897a9955f640fe2ad3d8e39691592138a5d21da2ab61474d86: Status 404 returned error can't find the container with id d821b4fdf29197897a9955f640fe2ad3d8e39691592138a5d21da2ab61474d86
Oct 30 21:31:43.467213 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.467183    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:31:43.467294 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:43.467242    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:31:44.171823 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:44.171791    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c" event={"ID":"5ec39432-edd3-4b69-9c57-45bcfc16c602","Type":"ContainerStarted","Data":"ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf"}
Oct 30 21:31:44.171823 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:44.171829    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c" event={"ID":"5ec39432-edd3-4b69-9c57-45bcfc16c602","Type":"ContainerStarted","Data":"d821b4fdf29197897a9955f640fe2ad3d8e39691592138a5d21da2ab61474d86"}
Oct 30 21:31:44.172239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:44.171940    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:44.172879 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:44.172856    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c" podUID="5ec39432-edd3-4b69-9c57-45bcfc16c602" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.133:8080/readyz\": dial tcp 10.134.0.133:8080: connect: connection refused"
Oct 30 21:31:44.294505 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:44.294450    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c" podStartSLOduration=2.294434138 podStartE2EDuration="2.294434138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:44.293868575 +0000 UTC m=+3279.249883352" watchObservedRunningTime="2026-10-30 21:31:44.294434138 +0000 UTC m=+3279.250448914"
Oct 30 21:31:45.177494 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.177467    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:45.348689 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.348650    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"]
Oct 30 21:31:45.348870 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.348824    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5" podUID="725b6fe6-eafa-445e-85d7-d4ab4ef15c99" containerName="ta-container" containerID="cri-o://6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0" gracePeriod=30
Oct 30 21:31:45.594856 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.594828    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:31:45.671218 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:31:45.671191    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:31:45.727557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.727479    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-kube-api-access-966ls\" (UniqueName: \"kubernetes.io/projected/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-kube-api-access-966ls\") pod \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") "
Oct 30 21:31:45.727557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.727514    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-data-science-collector-ta-server-cert\") pod \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") "
Oct 30 21:31:45.727745 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.727575    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-ta-internal\" (UniqueName: \"kubernetes.io/configmap/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-ta-internal\") pod \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\" (UID: \"725b6fe6-eafa-445e-85d7-d4ab4ef15c99\") "
Oct 30 21:31:45.727977 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.727955    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-ta-internal" pod "725b6fe6-eafa-445e-85d7-d4ab4ef15c99" (UID: "725b6fe6-eafa-445e-85d7-d4ab4ef15c99"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:31:45.729688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.729662    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-data-science-collector-ta-server-cert" pod "725b6fe6-eafa-445e-85d7-d4ab4ef15c99" (UID: "725b6fe6-eafa-445e-85d7-d4ab4ef15c99"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:31:45.729747 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.729695    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-kube-api-access-966ls" pod "725b6fe6-eafa-445e-85d7-d4ab4ef15c99" (UID: "725b6fe6-eafa-445e-85d7-d4ab4ef15c99"). InnerVolumeSpecName "kube-api-access-966ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:31:45.828396 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.828366    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-966ls\" (UniqueName: \"kubernetes.io/projected/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-kube-api-access-966ls\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:31:45.828396 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.828391    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:31:45.828582 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:45.828402    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/725b6fe6-eafa-445e-85d7-d4ab4ef15c99-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:31:46.182073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:46.181998    5937 generic.go:356] "Generic (PLEG): container finished" podID="725b6fe6-eafa-445e-85d7-d4ab4ef15c99" containerID="6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0" exitCode=0
Oct 30 21:31:46.182073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:46.182047    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"
Oct 30 21:31:46.182592 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:46.182082    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5" event={"ID":"725b6fe6-eafa-445e-85d7-d4ab4ef15c99","Type":"ContainerDied","Data":"6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0"}
Oct 30 21:31:46.182592 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:46.182128    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5" event={"ID":"725b6fe6-eafa-445e-85d7-d4ab4ef15c99","Type":"ContainerDied","Data":"493a99f9218390b5707678acc30c567c15e9fb1305a6594ab42a65089e607547"}
Oct 30 21:31:46.182592 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:46.182144    5937 scope.go:122] "RemoveContainer" containerID="6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0"
Oct 30 21:31:46.191512 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:46.191496    5937 scope.go:122] "RemoveContainer" containerID="6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0"
Oct 30 21:31:46.191822 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:31:46.191804    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0\": container with ID starting with 6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0 not found: ID does not exist" containerID="6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0"
Oct 30 21:31:46.191883 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:46.191832    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0"} err="failed to get container status \"6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0\": rpc error: code = NotFound desc = could not find container \"6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0\": container with ID starting with 6bee2013433a0201c0f9c17770eceb2953ad44a28295969e5cad8a9d231615e0 not found: ID does not exist"
Oct 30 21:31:46.349587 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:46.349559    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"]
Oct 30 21:31:46.400398 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:46.400374    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-fdzq5"]
Oct 30 21:31:47.161301 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:47.161272    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="725b6fe6-eafa-445e-85d7-d4ab4ef15c99" path="/var/lib/kubelet/pods/725b6fe6-eafa-445e-85d7-d4ab4ef15c99/volumes"
Oct 30 21:31:56.249677 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.249647    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"]
Oct 30 21:31:56.250134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.249979    5937 cpu_manager.go:414] "containerMap: removing container" podUID="725b6fe6-eafa-445e-85d7-d4ab4ef15c99" containerName="ta-container"
Oct 30 21:31:56.250134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.249989    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="725b6fe6-eafa-445e-85d7-d4ab4ef15c99" containerName="ta-container"
Oct 30 21:31:56.250134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.250078    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="725b6fe6-eafa-445e-85d7-d4ab4ef15c99" containerName="ta-container"
Oct 30 21:31:56.254167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.254148    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.317611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.317587    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"]
Oct 30 21:31:56.422704 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.422674    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f45b45d6c-z52lq\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.422833 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.422802    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grw6d\" (UniqueName: \"kubernetes.io/projected/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-kube-api-access-grw6d\") pod \"data-science-collector-targetallocator-f45b45d6c-z52lq\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.422891 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.422831    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-ta-internal\") pod \"data-science-collector-targetallocator-f45b45d6c-z52lq\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.523707 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.523642    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grw6d\" (UniqueName: \"kubernetes.io/projected/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-kube-api-access-grw6d\") pod \"data-science-collector-targetallocator-f45b45d6c-z52lq\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.523707 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.523680    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-ta-internal\") pod \"data-science-collector-targetallocator-f45b45d6c-z52lq\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.523895 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.523740    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f45b45d6c-z52lq\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.524337 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.524312    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-ta-internal\") pod \"data-science-collector-targetallocator-f45b45d6c-z52lq\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.526252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.526232    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-f45b45d6c-z52lq\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.586046 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.586019    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grw6d\" (UniqueName: \"kubernetes.io/projected/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-kube-api-access-grw6d\") pod \"data-science-collector-targetallocator-f45b45d6c-z52lq\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:56.866287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:56.866227    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:57.237771 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:57.237666    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"]
Oct 30 21:31:57.240041 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:31:57.240015    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69b17cb1_761e_4a90_8d8f_4bfe84dc0829.slice/crio-0229b1df5b0273e21feb1cf45620bbf08e2f53031654bf84a9f7ef9ed6fd41ed WatchSource:0}: Error finding container 0229b1df5b0273e21feb1cf45620bbf08e2f53031654bf84a9f7ef9ed6fd41ed: Status 404 returned error can't find the container with id 0229b1df5b0273e21feb1cf45620bbf08e2f53031654bf84a9f7ef9ed6fd41ed
Oct 30 21:31:57.242182 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:57.242153    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:31:57.242253 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:57.242207    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:31:58.238366 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:58.238322    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq" event={"ID":"69b17cb1-761e-4a90-8d8f-4bfe84dc0829","Type":"ContainerStarted","Data":"5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4"}
Oct 30 21:31:58.238840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:58.238374    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq" event={"ID":"69b17cb1-761e-4a90-8d8f-4bfe84dc0829","Type":"ContainerStarted","Data":"0229b1df5b0273e21feb1cf45620bbf08e2f53031654bf84a9f7ef9ed6fd41ed"}
Oct 30 21:31:58.238840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:58.238495    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:58.239482 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:58.239460    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq" podUID="69b17cb1-761e-4a90-8d8f-4bfe84dc0829" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.134:8080/readyz\": dial tcp 10.134.0.134:8080: connect: connection refused"
Oct 30 21:31:58.358771 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:58.358725    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq" podStartSLOduration=2.358711851 podStartE2EDuration="2.358711851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:58.35711692 +0000 UTC m=+3293.313131695" watchObservedRunningTime="2026-10-30 21:31:58.358711851 +0000 UTC m=+3293.314726623"
Oct 30 21:31:59.244657 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.244629    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:31:59.416116 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.416085    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"]
Oct 30 21:31:59.416325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.416302    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c" podUID="5ec39432-edd3-4b69-9c57-45bcfc16c602" containerName="ta-container" containerID="cri-o://ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf" gracePeriod=30
Oct 30 21:31:59.666006 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.665984    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:31:59.851004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.850929    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ec39432-edd3-4b69-9c57-45bcfc16c602-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ec39432-edd3-4b69-9c57-45bcfc16c602-data-science-collector-ta-server-cert\") pod \"5ec39432-edd3-4b69-9c57-45bcfc16c602\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") "
Oct 30 21:31:59.851004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.850996    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ec39432-edd3-4b69-9c57-45bcfc16c602-ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ec39432-edd3-4b69-9c57-45bcfc16c602-ta-internal\") pod \"5ec39432-edd3-4b69-9c57-45bcfc16c602\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") "
Oct 30 21:31:59.851236 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.851023    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ec39432-edd3-4b69-9c57-45bcfc16c602-kube-api-access-kg4sc\" (UniqueName: \"kubernetes.io/projected/5ec39432-edd3-4b69-9c57-45bcfc16c602-kube-api-access-kg4sc\") pod \"5ec39432-edd3-4b69-9c57-45bcfc16c602\" (UID: \"5ec39432-edd3-4b69-9c57-45bcfc16c602\") "
Oct 30 21:31:59.851399 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.851376    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec39432-edd3-4b69-9c57-45bcfc16c602-ta-internal" pod "5ec39432-edd3-4b69-9c57-45bcfc16c602" (UID: "5ec39432-edd3-4b69-9c57-45bcfc16c602"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:31:59.853242 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.853221    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec39432-edd3-4b69-9c57-45bcfc16c602-data-science-collector-ta-server-cert" pod "5ec39432-edd3-4b69-9c57-45bcfc16c602" (UID: "5ec39432-edd3-4b69-9c57-45bcfc16c602"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:31:59.853327 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.853314    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec39432-edd3-4b69-9c57-45bcfc16c602-kube-api-access-kg4sc" pod "5ec39432-edd3-4b69-9c57-45bcfc16c602" (UID: "5ec39432-edd3-4b69-9c57-45bcfc16c602"). InnerVolumeSpecName "kube-api-access-kg4sc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:31:59.952558 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.952509    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/5ec39432-edd3-4b69-9c57-45bcfc16c602-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:31:59.952558 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.952553    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/5ec39432-edd3-4b69-9c57-45bcfc16c602-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:31:59.952708 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:31:59.952566    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg4sc\" (UniqueName: \"kubernetes.io/projected/5ec39432-edd3-4b69-9c57-45bcfc16c602-kube-api-access-kg4sc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:00.249711 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:00.249681    5937 generic.go:356] "Generic (PLEG): container finished" podID="5ec39432-edd3-4b69-9c57-45bcfc16c602" containerID="ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf" exitCode=0
Oct 30 21:32:00.250117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:00.249728    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"
Oct 30 21:32:00.250117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:00.249760    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c" event={"ID":"5ec39432-edd3-4b69-9c57-45bcfc16c602","Type":"ContainerDied","Data":"ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf"}
Oct 30 21:32:00.250117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:00.249800    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c" event={"ID":"5ec39432-edd3-4b69-9c57-45bcfc16c602","Type":"ContainerDied","Data":"d821b4fdf29197897a9955f640fe2ad3d8e39691592138a5d21da2ab61474d86"}
Oct 30 21:32:00.250117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:00.249821    5937 scope.go:122] "RemoveContainer" containerID="ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf"
Oct 30 21:32:00.259002 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:00.258984    5937 scope.go:122] "RemoveContainer" containerID="ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf"
Oct 30 21:32:00.259279 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:32:00.259261    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf\": container with ID starting with ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf not found: ID does not exist" containerID="ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf"
Oct 30 21:32:00.259337 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:00.259287    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf"} err="failed to get container status \"ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf\": rpc error: code = NotFound desc = could not find container \"ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf\": container with ID starting with ca2c039c04f8207a88204967f3aff532ffd0a41bbdfc5c02e6c2ccaa40b76aaf not found: ID does not exist"
Oct 30 21:32:00.415308 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:00.415278    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"]
Oct 30 21:32:00.466157 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:00.466129    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6cf7bbd4b7-mvh9c"]
Oct 30 21:32:01.160918 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:01.160883    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ec39432-edd3-4b69-9c57-45bcfc16c602" path="/var/lib/kubelet/pods/5ec39432-edd3-4b69-9c57-45bcfc16c602/volumes"
Oct 30 21:32:15.671234 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:32:15.671192    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:32:43.143158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.143122    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"]
Oct 30 21:32:43.143708 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.143326    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x" podUID="14268376-5fa4-4e26-a55e-aeae74e0b033" containerName="thanos-querier" containerID="cri-o://09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330" gracePeriod=30
Oct 30 21:32:43.385844 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.385813    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"
Oct 30 21:32:43.440427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.440325    5937 generic.go:356] "Generic (PLEG): container finished" podID="14268376-5fa4-4e26-a55e-aeae74e0b033" containerID="09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330" exitCode=0
Oct 30 21:32:43.440427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.440367    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"
Oct 30 21:32:43.440427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.440403    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x" event={"ID":"14268376-5fa4-4e26-a55e-aeae74e0b033","Type":"ContainerDied","Data":"09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330"}
Oct 30 21:32:43.440749 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.440449    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x" event={"ID":"14268376-5fa4-4e26-a55e-aeae74e0b033","Type":"ContainerDied","Data":"8be7eb2389cd6d5da5bb0c33fafe19d042a083a0031bb5c4c5975c0a438049b5"}
Oct 30 21:32:43.440749 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.440473    5937 scope.go:122] "RemoveContainer" containerID="09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330"
Oct 30 21:32:43.449823 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.449791    5937 scope.go:122] "RemoveContainer" containerID="09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330"
Oct 30 21:32:43.450104 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:32:43.450081    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330\": container with ID starting with 09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330 not found: ID does not exist" containerID="09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330"
Oct 30 21:32:43.450152 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.450119    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330"} err="failed to get container status \"09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330\": rpc error: code = NotFound desc = could not find container \"09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330\": container with ID starting with 09247f3d243cfda5456ab9abc30b20ab24e8b81851c4483191108255672f7330 not found: ID does not exist"
Oct 30 21:32:43.502832 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.502805    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14268376-5fa4-4e26-a55e-aeae74e0b033-kube-api-access-d8n9g\" (UniqueName: \"kubernetes.io/projected/14268376-5fa4-4e26-a55e-aeae74e0b033-kube-api-access-d8n9g\") pod \"14268376-5fa4-4e26-a55e-aeae74e0b033\" (UID: \"14268376-5fa4-4e26-a55e-aeae74e0b033\") "
Oct 30 21:32:43.505313 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.505285    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14268376-5fa4-4e26-a55e-aeae74e0b033-kube-api-access-d8n9g" pod "14268376-5fa4-4e26-a55e-aeae74e0b033" (UID: "14268376-5fa4-4e26-a55e-aeae74e0b033"). InnerVolumeSpecName "kube-api-access-d8n9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:43.603751 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.603719    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8n9g\" (UniqueName: \"kubernetes.io/projected/14268376-5fa4-4e26-a55e-aeae74e0b033-kube-api-access-d8n9g\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:43.863356 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.863325    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"]
Oct 30 21:32:43.866095 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:43.866073    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-vkq2x"]
Oct 30 21:32:45.161384 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:45.161308    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14268376-5fa4-4e26-a55e-aeae74e0b033" path="/var/lib/kubelet/pods/14268376-5fa4-4e26-a55e-aeae74e0b033/volumes"
Oct 30 21:32:45.670976 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:32:45.670941    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:32:45.820073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:45.820039    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:32:45.820335 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:45.820290    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="055fe7a1-09b3-4552-84b4-f106d701ff10" containerName="otc-container" containerID="cri-o://488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663" gracePeriod=30
Oct 30 21:32:45.869858 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:45.869831    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"]
Oct 30 21:32:45.870029 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:45.870007    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq" podUID="69b17cb1-761e-4a90-8d8f-4bfe84dc0829" containerName="ta-container" containerID="cri-o://5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4" gracePeriod=30
Oct 30 21:32:46.132357 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.132334    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:32:46.135006 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.134989    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:32:46.226743 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.226673    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-ta-internal\" (UniqueName: \"kubernetes.io/configmap/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-ta-internal\") pod \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") "
Oct 30 21:32:46.226743 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.226709    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/055fe7a1-09b3-4552-84b4-f106d701ff10-otc-internal\" (UniqueName: \"kubernetes.io/configmap/055fe7a1-09b3-4552-84b4-f106d701ff10-otc-internal\") pod \"055fe7a1-09b3-4552-84b4-f106d701ff10\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") "
Oct 30 21:32:46.227577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.226741    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-data-science-collector-ta-server-cert\") pod \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") "
Oct 30 21:32:46.227577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.226776    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/055fe7a1-09b3-4552-84b4-f106d701ff10-kube-api-access-8wg7d\" (UniqueName: \"kubernetes.io/projected/055fe7a1-09b3-4552-84b4-f106d701ff10-kube-api-access-8wg7d\") pod \"055fe7a1-09b3-4552-84b4-f106d701ff10\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") "
Oct 30 21:32:46.227577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.226805    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-kube-api-access-grw6d\" (UniqueName: \"kubernetes.io/projected/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-kube-api-access-grw6d\") pod \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\" (UID: \"69b17cb1-761e-4a90-8d8f-4bfe84dc0829\") "
Oct 30 21:32:46.227577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.226878    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs\") pod \"055fe7a1-09b3-4552-84b4-f106d701ff10\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") "
Oct 30 21:32:46.227577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.226907    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-tls-certs\") pod \"055fe7a1-09b3-4552-84b4-f106d701ff10\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") "
Oct 30 21:32:46.227577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.226986    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-monitoring-tls-certs\") pod \"055fe7a1-09b3-4552-84b4-f106d701ff10\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") "
Oct 30 21:32:46.227577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.227033    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-data-science-collector-ta-client-cert\") pod \"055fe7a1-09b3-4552-84b4-f106d701ff10\" (UID: \"055fe7a1-09b3-4552-84b4-f106d701ff10\") "
Oct 30 21:32:46.227577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.227215    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-ta-internal" pod "69b17cb1-761e-4a90-8d8f-4bfe84dc0829" (UID: "69b17cb1-761e-4a90-8d8f-4bfe84dc0829"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:46.229689 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.227622    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055fe7a1-09b3-4552-84b4-f106d701ff10-otc-internal" pod "055fe7a1-09b3-4552-84b4-f106d701ff10" (UID: "055fe7a1-09b3-4552-84b4-f106d701ff10"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:46.232214 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.232191    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/055fe7a1-09b3-4552-84b4-f106d701ff10-kube-api-access-8wg7d" pod "055fe7a1-09b3-4552-84b4-f106d701ff10" (UID: "055fe7a1-09b3-4552-84b4-f106d701ff10"). InnerVolumeSpecName "kube-api-access-8wg7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:46.234831 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.234797    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-tls-certs" pod "055fe7a1-09b3-4552-84b4-f106d701ff10" (UID: "055fe7a1-09b3-4552-84b4-f106d701ff10"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:46.234935 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.234833    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-kube-api-access-grw6d" pod "69b17cb1-761e-4a90-8d8f-4bfe84dc0829" (UID: "69b17cb1-761e-4a90-8d8f-4bfe84dc0829"). InnerVolumeSpecName "kube-api-access-grw6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:46.234935 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.234859    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-data-science-collector-ta-server-cert" pod "69b17cb1-761e-4a90-8d8f-4bfe84dc0829" (UID: "69b17cb1-761e-4a90-8d8f-4bfe84dc0829"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:46.235025 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.235005    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-monitoring-tls-certs" pod "055fe7a1-09b3-4552-84b4-f106d701ff10" (UID: "055fe7a1-09b3-4552-84b4-f106d701ff10"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:46.235121 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.235102    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-data-science-collector-ta-client-cert" pod "055fe7a1-09b3-4552-84b4-f106d701ff10" (UID: "055fe7a1-09b3-4552-84b4-f106d701ff10"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:46.235158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.235118    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs" pod "055fe7a1-09b3-4552-84b4-f106d701ff10" (UID: "055fe7a1-09b3-4552-84b4-f106d701ff10"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:32:46.242721 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.242697    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:32:46.242938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.242899    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="73e6ed46-cea0-4ee5-b240-36c135adab49" containerName="perses" containerID="cri-o://8efdcd610c0cf27bc705432bb509409daa78eb70c866a9af6b6ba777230c5961" gracePeriod=30
Oct 30 21:32:46.328287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.328258    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-data-science-collector-ta-client-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.328287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.328286    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.328481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.328297    5937 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/055fe7a1-09b3-4552-84b4-f106d701ff10-otc-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.328481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.328306    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.328481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.328315    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wg7d\" (UniqueName: \"kubernetes.io/projected/055fe7a1-09b3-4552-84b4-f106d701ff10-kube-api-access-8wg7d\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.328481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.328324    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grw6d\" (UniqueName: \"kubernetes.io/projected/69b17cb1-761e-4a90-8d8f-4bfe84dc0829-kube-api-access-grw6d\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.328481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.328333    5937 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-otlp-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.328481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.328342    5937 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.328481 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.328350    5937 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/055fe7a1-09b3-4552-84b4-f106d701ff10-monitoring-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.456048 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.456014    5937 generic.go:356] "Generic (PLEG): container finished" podID="69b17cb1-761e-4a90-8d8f-4bfe84dc0829" containerID="5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4" exitCode=0
Oct 30 21:32:46.456206 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.456064    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"
Oct 30 21:32:46.456206 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.456095    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq" event={"ID":"69b17cb1-761e-4a90-8d8f-4bfe84dc0829","Type":"ContainerDied","Data":"5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4"}
Oct 30 21:32:46.456206 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.456140    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq" event={"ID":"69b17cb1-761e-4a90-8d8f-4bfe84dc0829","Type":"ContainerDied","Data":"0229b1df5b0273e21feb1cf45620bbf08e2f53031654bf84a9f7ef9ed6fd41ed"}
Oct 30 21:32:46.456206 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.456165    5937 scope.go:122] "RemoveContainer" containerID="5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4"
Oct 30 21:32:46.457922 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.457902    5937 generic.go:356] "Generic (PLEG): container finished" podID="73e6ed46-cea0-4ee5-b240-36c135adab49" containerID="8efdcd610c0cf27bc705432bb509409daa78eb70c866a9af6b6ba777230c5961" exitCode=0
Oct 30 21:32:46.458046 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.457991    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"73e6ed46-cea0-4ee5-b240-36c135adab49","Type":"ContainerDied","Data":"8efdcd610c0cf27bc705432bb509409daa78eb70c866a9af6b6ba777230c5961"}
Oct 30 21:32:46.459601 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.459581    5937 generic.go:356] "Generic (PLEG): container finished" podID="055fe7a1-09b3-4552-84b4-f106d701ff10" containerID="488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663" exitCode=0
Oct 30 21:32:46.459705 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.459617    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"055fe7a1-09b3-4552-84b4-f106d701ff10","Type":"ContainerDied","Data":"488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663"}
Oct 30 21:32:46.459705 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.459644    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:32:46.459705 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.459655    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"055fe7a1-09b3-4552-84b4-f106d701ff10","Type":"ContainerDied","Data":"c24d3ca194a2a5dc5741ea8fda280fc0b9049d7fa467179b8e370ec0e71df3d1"}
Oct 30 21:32:46.468870 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.468830    5937 scope.go:122] "RemoveContainer" containerID="5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4"
Oct 30 21:32:46.469202 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:32:46.469180    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4\": container with ID starting with 5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4 not found: ID does not exist" containerID="5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4"
Oct 30 21:32:46.469290 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.469213    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4"} err="failed to get container status \"5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4\": rpc error: code = NotFound desc = could not find container \"5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4\": container with ID starting with 5594f059aaca94bb16d24c9414ac07e9af949e5d0c7d6764d9286ac6616ea5c4 not found: ID does not exist"
Oct 30 21:32:46.469290 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.469235    5937 scope.go:122] "RemoveContainer" containerID="488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663"
Oct 30 21:32:46.478180 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.478147    5937 scope.go:122] "RemoveContainer" containerID="488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663"
Oct 30 21:32:46.478470 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:32:46.478453    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663\": container with ID starting with 488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663 not found: ID does not exist" containerID="488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663"
Oct 30 21:32:46.478521 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.478475    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663"} err="failed to get container status \"488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663\": rpc error: code = NotFound desc = could not find container \"488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663\": container with ID starting with 488da8554d48790937500d567628a6bd8c417e4fd7624b836dd6de264222e663 not found: ID does not exist"
Oct 30 21:32:46.488622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.488604    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:32:46.605647 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.605621    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:32:46.610276 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.610253    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:32:46.630319 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.630299    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/73e6ed46-cea0-4ee5-b240-36c135adab49-kube-api-access-99sfq\" (UniqueName: \"kubernetes.io/projected/73e6ed46-cea0-4ee5-b240-36c135adab49-kube-api-access-99sfq\") pod \"73e6ed46-cea0-4ee5-b240-36c135adab49\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") "
Oct 30 21:32:46.630418 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.630345    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/73e6ed46-cea0-4ee5-b240-36c135adab49-config\" (UniqueName: \"kubernetes.io/configmap/73e6ed46-cea0-4ee5-b240-36c135adab49-config\") pod \"73e6ed46-cea0-4ee5-b240-36c135adab49\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") "
Oct 30 21:32:46.630490 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.630438    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"73e6ed46-cea0-4ee5-b240-36c135adab49\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") "
Oct 30 21:32:46.630490 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.630479    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/73e6ed46-cea0-4ee5-b240-36c135adab49-plugins\" (UniqueName: \"kubernetes.io/empty-dir/73e6ed46-cea0-4ee5-b240-36c135adab49-plugins\") pod \"73e6ed46-cea0-4ee5-b240-36c135adab49\" (UID: \"73e6ed46-cea0-4ee5-b240-36c135adab49\") "
Oct 30 21:32:46.630720 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.630698    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73e6ed46-cea0-4ee5-b240-36c135adab49-config" pod "73e6ed46-cea0-4ee5-b240-36c135adab49" (UID: "73e6ed46-cea0-4ee5-b240-36c135adab49"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:32:46.632474 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.632452    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73e6ed46-cea0-4ee5-b240-36c135adab49-kube-api-access-99sfq" pod "73e6ed46-cea0-4ee5-b240-36c135adab49" (UID: "73e6ed46-cea0-4ee5-b240-36c135adab49"). InnerVolumeSpecName "kube-api-access-99sfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:32:46.633317 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.633296    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "73e6ed46-cea0-4ee5-b240-36c135adab49" (UID: "73e6ed46-cea0-4ee5-b240-36c135adab49"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:32:46.721289 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.721260    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"]
Oct 30 21:32:46.727821 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.727803    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-f45b45d6c-z52lq"]
Oct 30 21:32:46.731347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.731290    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99sfq\" (UniqueName: \"kubernetes.io/projected/73e6ed46-cea0-4ee5-b240-36c135adab49-kube-api-access-99sfq\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.731347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.731311    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/73e6ed46-cea0-4ee5-b240-36c135adab49-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:46.731347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.731336    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:32:46.744235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.744219    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:32:46.777505 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.777483    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73e6ed46-cea0-4ee5-b240-36c135adab49-plugins" pod "73e6ed46-cea0-4ee5-b240-36c135adab49" (UID: "73e6ed46-cea0-4ee5-b240-36c135adab49"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:32:46.831998 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.831972    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:32:46.831998 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:46.831994    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/73e6ed46-cea0-4ee5-b240-36c135adab49-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:32:47.161192 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:47.161104    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="055fe7a1-09b3-4552-84b4-f106d701ff10" path="/var/lib/kubelet/pods/055fe7a1-09b3-4552-84b4-f106d701ff10/volumes"
Oct 30 21:32:47.161602 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:47.161583    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69b17cb1-761e-4a90-8d8f-4bfe84dc0829" path="/var/lib/kubelet/pods/69b17cb1-761e-4a90-8d8f-4bfe84dc0829/volumes"
Oct 30 21:32:47.466222 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:47.466192    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:32:47.466739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:47.466192    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"73e6ed46-cea0-4ee5-b240-36c135adab49","Type":"ContainerDied","Data":"52e8eacd4d2329a3623eb48e230349728e910e26bc622aad04c88c2583fb951c"}
Oct 30 21:32:47.466739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:47.466312    5937 scope.go:122] "RemoveContainer" containerID="8efdcd610c0cf27bc705432bb509409daa78eb70c866a9af6b6ba777230c5961"
Oct 30 21:32:47.632772 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:47.632740    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:32:47.638702 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:47.638676    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:32:49.161392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.161355    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="73e6ed46-cea0-4ee5-b240-36c135adab49" path="/var/lib/kubelet/pods/73e6ed46-cea0-4ee5-b240-36c135adab49/volumes"
Oct 30 21:32:49.656038 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656004    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:32:49.656377 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656363    5937 cpu_manager.go:414] "containerMap: removing container" podUID="73e6ed46-cea0-4ee5-b240-36c135adab49" containerName="perses"
Oct 30 21:32:49.656422 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656379    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="73e6ed46-cea0-4ee5-b240-36c135adab49" containerName="perses"
Oct 30 21:32:49.656422 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656388    5937 cpu_manager.go:414] "containerMap: removing container" podUID="69b17cb1-761e-4a90-8d8f-4bfe84dc0829" containerName="ta-container"
Oct 30 21:32:49.656422 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656393    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69b17cb1-761e-4a90-8d8f-4bfe84dc0829" containerName="ta-container"
Oct 30 21:32:49.656422 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656416    5937 cpu_manager.go:414] "containerMap: removing container" podUID="5ec39432-edd3-4b69-9c57-45bcfc16c602" containerName="ta-container"
Oct 30 21:32:49.656422 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656423    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ec39432-edd3-4b69-9c57-45bcfc16c602" containerName="ta-container"
Oct 30 21:32:49.656596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656434    5937 cpu_manager.go:414] "containerMap: removing container" podUID="14268376-5fa4-4e26-a55e-aeae74e0b033" containerName="thanos-querier"
Oct 30 21:32:49.656596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656439    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14268376-5fa4-4e26-a55e-aeae74e0b033" containerName="thanos-querier"
Oct 30 21:32:49.656596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656446    5937 cpu_manager.go:414] "containerMap: removing container" podUID="055fe7a1-09b3-4552-84b4-f106d701ff10" containerName="otc-container"
Oct 30 21:32:49.656596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656450    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="055fe7a1-09b3-4552-84b4-f106d701ff10" containerName="otc-container"
Oct 30 21:32:49.656596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656502    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="73e6ed46-cea0-4ee5-b240-36c135adab49" containerName="perses"
Oct 30 21:32:49.656596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656509    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="69b17cb1-761e-4a90-8d8f-4bfe84dc0829" containerName="ta-container"
Oct 30 21:32:49.656596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656517    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ec39432-edd3-4b69-9c57-45bcfc16c602" containerName="ta-container"
Oct 30 21:32:49.656596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656524    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="14268376-5fa4-4e26-a55e-aeae74e0b033" containerName="thanos-querier"
Oct 30 21:32:49.656596 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.656530    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="055fe7a1-09b3-4552-84b4-f106d701ff10" containerName="otc-container"
Oct 30 21:32:49.678212 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.678186    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:32:49.716092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.716059    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:32:49.766031 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.766001    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:32:49.766031 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.766006    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:32:49.766188 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.766057    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:32:49.857197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.857171    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb99a257-6331-4108-a724-662fcd693d27-data\") pod \"seaweedfs\" (UID: \"bb99a257-6331-4108-a724-662fcd693d27\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:32:49.857379 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.857221    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6c4n\" (UniqueName: \"kubernetes.io/projected/bb99a257-6331-4108-a724-662fcd693d27-kube-api-access-n6c4n\") pod \"seaweedfs\" (UID: \"bb99a257-6331-4108-a724-662fcd693d27\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:32:49.958167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.958146    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb99a257-6331-4108-a724-662fcd693d27-data\") pod \"seaweedfs\" (UID: \"bb99a257-6331-4108-a724-662fcd693d27\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:32:49.958275 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.958194    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6c4n\" (UniqueName: \"kubernetes.io/projected/bb99a257-6331-4108-a724-662fcd693d27-kube-api-access-n6c4n\") pod \"seaweedfs\" (UID: \"bb99a257-6331-4108-a724-662fcd693d27\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:32:49.958504 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:49.958487    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb99a257-6331-4108-a724-662fcd693d27-data\") pod \"seaweedfs\" (UID: \"bb99a257-6331-4108-a724-662fcd693d27\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:32:50.021277 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:50.021245    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6c4n\" (UniqueName: \"kubernetes.io/projected/bb99a257-6331-4108-a724-662fcd693d27-kube-api-access-n6c4n\") pod \"seaweedfs\" (UID: \"bb99a257-6331-4108-a724-662fcd693d27\") " pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:32:50.290157 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:50.290080    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:32:50.658212 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:50.658138    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:32:50.661274 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:32:50.661243    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb99a257_6331_4108_a724_662fcd693d27.slice/crio-3ab3ded62f92e3cdb23ecbf5e22cc72bb61067082a77f37b06d00e075a959d16 WatchSource:0}: Error finding container 3ab3ded62f92e3cdb23ecbf5e22cc72bb61067082a77f37b06d00e075a959d16: Status 404 returned error can't find the container with id 3ab3ded62f92e3cdb23ecbf5e22cc72bb61067082a77f37b06d00e075a959d16
Oct 30 21:32:51.491202 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:51.491159    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"bb99a257-6331-4108-a724-662fcd693d27","Type":"ContainerStarted","Data":"cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b"}
Oct 30 21:32:51.491202 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:51.491205    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"bb99a257-6331-4108-a724-662fcd693d27","Type":"ContainerStarted","Data":"3ab3ded62f92e3cdb23ecbf5e22cc72bb61067082a77f37b06d00e075a959d16"}
Oct 30 21:32:51.491665 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:51.491285    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:32:51.607694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:32:51.607642    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/seaweedfs" podStartSLOduration=2.607627025 podStartE2EDuration="2.607627025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:32:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:32:51.607191401 +0000 UTC m=+3346.563206174" watchObservedRunningTime="2026-10-30 21:32:51.607627025 +0000 UTC m=+3346.563641801"
Oct 30 21:33:02.498080 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:02.498050    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:33:03.925667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:03.925636    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:33:03.929094 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:03.929079    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:33:03.985662 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:03.985636    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:33:04.071023 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:04.070996    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqhvs\" (UniqueName: \"kubernetes.io/projected/3c1dd05f-8218-4879-8b1a-5a436fda6979-kube-api-access-dqhvs\") pod \"seaweedfs-bucket-creator\" (UID: \"3c1dd05f-8218-4879-8b1a-5a436fda6979\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:33:04.171645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:04.171620    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqhvs\" (UniqueName: \"kubernetes.io/projected/3c1dd05f-8218-4879-8b1a-5a436fda6979-kube-api-access-dqhvs\") pod \"seaweedfs-bucket-creator\" (UID: \"3c1dd05f-8218-4879-8b1a-5a436fda6979\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:33:04.234444 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:04.234419    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqhvs\" (UniqueName: \"kubernetes.io/projected/3c1dd05f-8218-4879-8b1a-5a436fda6979-kube-api-access-dqhvs\") pod \"seaweedfs-bucket-creator\" (UID: \"3c1dd05f-8218-4879-8b1a-5a436fda6979\") " pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:33:04.240207 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:04.240188    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:33:04.607416 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:04.607163    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:33:04.609894 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:33:04.609866    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c1dd05f_8218_4879_8b1a_5a436fda6979.slice/crio-9a1c1d37fff1460a114aa973a3cf704a06dba9fecffbd0a98fcf141d38702af6 WatchSource:0}: Error finding container 9a1c1d37fff1460a114aa973a3cf704a06dba9fecffbd0a98fcf141d38702af6: Status 404 returned error can't find the container with id 9a1c1d37fff1460a114aa973a3cf704a06dba9fecffbd0a98fcf141d38702af6
Oct 30 21:33:05.552740 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:05.552667    5937 generic.go:356] "Generic (PLEG): container finished" podID="3c1dd05f-8218-4879-8b1a-5a436fda6979" containerID="6c87b598377a02394b71b0f0b172e7ef19e1a3eb6574d8170ffb4efa714648ca" exitCode=0
Oct 30 21:33:05.553096 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:05.552758    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"3c1dd05f-8218-4879-8b1a-5a436fda6979","Type":"ContainerDied","Data":"6c87b598377a02394b71b0f0b172e7ef19e1a3eb6574d8170ffb4efa714648ca"}
Oct 30 21:33:05.553096 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:05.552806    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"3c1dd05f-8218-4879-8b1a-5a436fda6979","Type":"ContainerStarted","Data":"9a1c1d37fff1460a114aa973a3cf704a06dba9fecffbd0a98fcf141d38702af6"}
Oct 30 21:33:06.690043 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:06.690021    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:33:06.790438 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:06.790412    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c1dd05f-8218-4879-8b1a-5a436fda6979-kube-api-access-dqhvs\" (UniqueName: \"kubernetes.io/projected/3c1dd05f-8218-4879-8b1a-5a436fda6979-kube-api-access-dqhvs\") pod \"3c1dd05f-8218-4879-8b1a-5a436fda6979\" (UID: \"3c1dd05f-8218-4879-8b1a-5a436fda6979\") "
Oct 30 21:33:06.792504 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:06.792475    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1dd05f-8218-4879-8b1a-5a436fda6979-kube-api-access-dqhvs" pod "3c1dd05f-8218-4879-8b1a-5a436fda6979" (UID: "3c1dd05f-8218-4879-8b1a-5a436fda6979"). InnerVolumeSpecName "kube-api-access-dqhvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:33:06.891117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:06.891049    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqhvs\" (UniqueName: \"kubernetes.io/projected/3c1dd05f-8218-4879-8b1a-5a436fda6979-kube-api-access-dqhvs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:33:07.561865 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:07.561840    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs-bucket-creator"
Oct 30 21:33:07.562040 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:07.561864    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs-bucket-creator" event={"ID":"3c1dd05f-8218-4879-8b1a-5a436fda6979","Type":"ContainerDied","Data":"9a1c1d37fff1460a114aa973a3cf704a06dba9fecffbd0a98fcf141d38702af6"}
Oct 30 21:33:07.562040 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:07.561901    5937 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a1c1d37fff1460a114aa973a3cf704a06dba9fecffbd0a98fcf141d38702af6"
Oct 30 21:33:12.533316 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.533282    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"]
Oct 30 21:33:12.533711 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.533650    5937 cpu_manager.go:414] "containerMap: removing container" podUID="3c1dd05f-8218-4879-8b1a-5a436fda6979" containerName="create-bucket"
Oct 30 21:33:12.533711 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.533662    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c1dd05f-8218-4879-8b1a-5a436fda6979" containerName="create-bucket"
Oct 30 21:33:12.533788 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.533732    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c1dd05f-8218-4879-8b1a-5a436fda6979" containerName="create-bucket"
Oct 30 21:33:12.536430 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.536413    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.635875 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.635844    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-grpc\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.635875 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.635880    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxjbd\" (UniqueName: \"kubernetes.io/projected/219f0034-c3e2-45a8-8ce6-420ad6711335-kube-api-access-bxjbd\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.636089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.635899    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-http\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.636089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.636010    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.636089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.636064    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-config\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.640966 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.640947    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-ca-bundle\""
Oct 30 21:33:12.641095 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.640994    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-distributor-http\""
Oct 30 21:33:12.641095 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.641049    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-distributor-grpc\""
Oct 30 21:33:12.641095 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.641067    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-dockercfg-g2x6b\""
Oct 30 21:33:12.641306 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.641289    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-config\""
Oct 30 21:33:12.642022 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.642001    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"]
Oct 30 21:33:12.737233 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.737206    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.737362 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.737265    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-config\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.737415 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.737384    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-grpc\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.737460 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.737411    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxjbd\" (UniqueName: \"kubernetes.io/projected/219f0034-c3e2-45a8-8ce6-420ad6711335-kube-api-access-bxjbd\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.737460 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.737439    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-http\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.738028 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.738007    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-config\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.738277 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.738030    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.740110 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.740084    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-grpc\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.740206 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.740105    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-http\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.803254 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.803188    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxjbd\" (UniqueName: \"kubernetes.io/projected/219f0034-c3e2-45a8-8ce6-420ad6711335-kube-api-access-bxjbd\") pod \"data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:12.847621 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:12.847590    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:13.218463 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:13.218431    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"]
Oct 30 21:33:13.221596 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:33:13.221555    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod219f0034_c3e2_45a8_8ce6_420ad6711335.slice/crio-b7f96208b1b9b17f5c20f9ecee031fce205132ec760b5d4d3030149466a2c74c WatchSource:0}: Error finding container b7f96208b1b9b17f5c20f9ecee031fce205132ec760b5d4d3030149466a2c74c: Status 404 returned error can't find the container with id b7f96208b1b9b17f5c20f9ecee031fce205132ec760b5d4d3030149466a2c74c
Oct 30 21:33:13.223623 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:13.223607    5937 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:33:13.590323 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:13.590245    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb" event={"ID":"219f0034-c3e2-45a8-8ce6-420ad6711335","Type":"ContainerStarted","Data":"b7f96208b1b9b17f5c20f9ecee031fce205132ec760b5d4d3030149466a2c74c"}
Oct 30 21:33:14.251715 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.251685    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"]
Oct 30 21:33:14.256256 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.256239    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.318736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.318712    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway\""
Oct 30 21:33:14.318960 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.318941    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway\""
Oct 30 21:33:14.319041 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.318942    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway-http\""
Oct 30 21:33:14.319041 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.318952    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway-ca-bundle\""
Oct 30 21:33:14.319041 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.318996    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway-client-http\""
Oct 30 21:33:14.350529 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.350501    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.350674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.350569    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24zw5\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-kube-api-access-24zw5\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.350739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.350674    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-client-http\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.350739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.350714    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.350882 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.350824    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.350945 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.350921    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tenants\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.351017 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.350959    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.351205 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.351103    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-lokistack-gateway\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.368184 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.368159    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"]
Oct 30 21:33:14.452432 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.452403    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-client-http\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.452600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.452437    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.452600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.452461    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.452600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.452483    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tenants\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.452600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.452502    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.452600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.452565    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-lokistack-gateway\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.452600 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:33:14.452589    5937 projected.go:266] Couldn't get secret redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-http: secret "data-science-usage-logs-lokistack-gateway-http" not found
Oct 30 21:33:14.452942 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:33:14.452617    5937 projected.go:266] Couldn't get secret redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-http: secret "data-science-usage-logs-lokistack-gateway-http" not found
Oct 30 21:33:14.452942 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:33:14.452615    5937 projected.go:304] Couldn't get configMap payload redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-ca-bundle: configmap references non-existent config key: service-ca.crt
Oct 30 21:33:14.452942 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:33:14.452630    5937 projected.go:196] Error preparing data for projected volume tls-secret for pod redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk: secret "data-science-usage-logs-lokistack-gateway-http" not found
Oct 30 21:33:14.452942 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:33:14.452635    5937 projected.go:196] Error preparing data for projected volume data-science-usage-logs-lokistack-gateway-ca-bundle for pod redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk: configmap references non-existent config key: service-ca.crt
Oct 30 21:33:14.452942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.452598    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.452942 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:33:14.452703    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret podName:e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c nodeName:}" failed. No retries permitted until 2026-10-30 21:33:14.952678238 +0000 UTC m=+3369.908692997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-secret" (UniqueName: "kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret") pod "data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c") : secret "data-science-usage-logs-lokistack-gateway-http" not found
Oct 30 21:33:14.452942 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:33:14.452735    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle podName:e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c nodeName:}" failed. No retries permitted until 2026-10-30 21:33:14.952722648 +0000 UTC m=+3369.908737414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "data-science-usage-logs-lokistack-gateway-ca-bundle" (UniqueName: "kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle") pod "data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c") : configmap references non-existent config key: service-ca.crt
Oct 30 21:33:14.452942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.452782    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24zw5\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-kube-api-access-24zw5\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.453406 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.453388    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.453443 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.453427    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-lokistack-gateway\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.453477 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.453427    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.455206 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.455178    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-client-http\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.455447 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.455428    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tenants\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.515660 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.515597    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24zw5\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-kube-api-access-24zw5\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.957828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.957799    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.958193 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.957843    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.960354 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.960331    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:14.960471 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:14.960451    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret\") pod \"data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:15.170317 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:15.170283    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:15.645559 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:33:15.645508    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode90d2fbb_f9ea_43bb_84c8_8b4ac11a6b2c.slice/crio-02591e62ed85639353051e7adee417150561f3f076cce8dbfe553887650c8af6 WatchSource:0}: Error finding container 02591e62ed85639353051e7adee417150561f3f076cce8dbfe553887650c8af6: Status 404 returned error can't find the container with id 02591e62ed85639353051e7adee417150561f3f076cce8dbfe553887650c8af6
Oct 30 21:33:15.671804 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:33:15.671770    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:33:15.692893 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:15.692867    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"]
Oct 30 21:33:16.604016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:16.603975    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" event={"ID":"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c","Type":"ContainerStarted","Data":"02591e62ed85639353051e7adee417150561f3f076cce8dbfe553887650c8af6"}
Oct 30 21:33:16.817593 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:16.817561    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"]
Oct 30 21:33:16.820932 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:16.820911    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:16.925287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:16.925201    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-usage-logs-loki-secret\""
Oct 30 21:33:16.925287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:16.925224    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-index-gateway-grpc\""
Oct 30 21:33:16.925287 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:16.925207    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-index-gateway-http\""
Oct 30 21:33:16.926590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:16.926570    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"]
Oct 30 21:33:17.076803 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.076758    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-grpc\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.076990 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.076826    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-test-usage-logs-loki-secret\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.076990 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.076940    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-config\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.077282 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.077004    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-http\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.077282 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.077069    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8zkm\" (UniqueName: \"kubernetes.io/projected/b2a37c64-507c-400a-a453-02cabf5328eb-kube-api-access-t8zkm\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.077282 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.077181    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.178337 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.178252    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-config\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.178337 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.178326    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-http\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.178573 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.178347    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8zkm\" (UniqueName: \"kubernetes.io/projected/b2a37c64-507c-400a-a453-02cabf5328eb-kube-api-access-t8zkm\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.178573 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.178418    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.178573 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.178448    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-grpc\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.178573 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.178485    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-test-usage-logs-loki-secret\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.179408 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.179376    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-config\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.179408 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.179401    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.181276 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.181250    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-http\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.181490 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.181474    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-grpc\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.181628 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.181602    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-test-usage-logs-loki-secret\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:17.241881 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:17.241845    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8zkm\" (UniqueName: \"kubernetes.io/projected/b2a37c64-507c-400a-a453-02cabf5328eb-kube-api-access-t8zkm\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:18.615629 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:18.615529    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb" event={"ID":"219f0034-c3e2-45a8-8ce6-420ad6711335","Type":"ContainerStarted","Data":"99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216"}
Oct 30 21:33:18.615975 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:18.615679    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:18.736574 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:18.736501    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb" podStartSLOduration=2.169903749 podStartE2EDuration="6.73648911s" totalImagesPullingTime="4.566585361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:33:18.736044922 +0000 UTC m=+3373.692059697" watchObservedRunningTime="2026-10-30 21:33:18.73648911 +0000 UTC m=+3373.692503887"
Oct 30 21:33:19.197132 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:19.197092    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:19.304408 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:19.304373    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") device path: \"\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:19.398634 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:19.398598    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:19.398835 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:19.398714    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:19.452180 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:19.452103    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") DevicePath \"csi-1555c7da07e14bc565211747225679e1cc79e7847b06e88c78b2ca29051ed84d\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:19.724908 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:19.724870    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/16847625ef5b169474e6c7fa0db03454ec63f6f80fcb0eec5f5f82909c6eec52/globalmount\"" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:19.791117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:19.791080    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") pod \"data-science-usage-logs-lokistack-index-gateway-0\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:20.136488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:20.136460    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:20.558119 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:20.558090    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"]
Oct 30 21:33:20.560962 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:33:20.560940    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2a37c64_507c_400a_a453_02cabf5328eb.slice/crio-7186570807c27239702526570969bc5324ca3ab68f85ffdcbb58039f1cc1594b WatchSource:0}: Error finding container 7186570807c27239702526570969bc5324ca3ab68f85ffdcbb58039f1cc1594b: Status 404 returned error can't find the container with id 7186570807c27239702526570969bc5324ca3ab68f85ffdcbb58039f1cc1594b
Oct 30 21:33:20.627369 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:20.627344    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" event={"ID":"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c","Type":"ContainerStarted","Data":"af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe"}
Oct 30 21:33:20.629038 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:20.629014    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0" event={"ID":"b2a37c64-507c-400a-a453-02cabf5328eb","Type":"ContainerStarted","Data":"35ce4a9321a136746fb83d14f2aa99744f2f3b8c4cd1c7a2f72ff15cf4937f5b"}
Oct 30 21:33:20.629159 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:20.629047    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0" event={"ID":"b2a37c64-507c-400a-a453-02cabf5328eb","Type":"ContainerStarted","Data":"7186570807c27239702526570969bc5324ca3ab68f85ffdcbb58039f1cc1594b"}
Oct 30 21:33:20.629159 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:20.629135    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:20.751050 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:20.751004    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0" podStartSLOduration=7.750991756 podStartE2EDuration="7.750991756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:33:20.750599763 +0000 UTC m=+3375.706614540" watchObservedRunningTime="2026-10-30 21:33:20.750991756 +0000 UTC m=+3375.707006531"
Oct 30 21:33:25.653022 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:25.652988    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" event={"ID":"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c","Type":"ContainerStarted","Data":"4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1"}
Oct 30 21:33:25.653436 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:25.653213    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:25.658851 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:25.658831    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:25.852362 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:25.852316    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" podStartSLOduration=2.532171222 podStartE2EDuration="11.852304708s" totalImagesPullingTime="9.320133486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:33:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:33:25.826003481 +0000 UTC m=+3380.782018257" watchObservedRunningTime="2026-10-30 21:33:25.852304708 +0000 UTC m=+3380.808319476"
Oct 30 21:33:26.657271 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:26.657241    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:26.665349 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:26.665328    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:33:39.628787 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:39.628753    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:33:41.640338 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:33:41.640308    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:33:45.671999 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:33:45.671961    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:34:06.228177 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:34:06.228146    5937 scope.go:122] "RemoveContainer" containerID="7599cb00b2da5c381dce5166f7a2cab33b77e7e11984c855907958e68b441056"
Oct 30 21:34:06.236372 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:34:06.236352    5937 scope.go:122] "RemoveContainer" containerID="33c1ca844d1ad04b33693eb58d6b07df87cd69d62bf1cb42ae64447fc430115d"
Oct 30 21:34:06.243956 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:34:06.243937    5937 scope.go:122] "RemoveContainer" containerID="13f254107d08e006345a977fa127d7290bfa7e217e773fe54421b34589b5dfb6"
Oct 30 21:34:06.251275 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:34:06.251255    5937 scope.go:122] "RemoveContainer" containerID="1c955b13699504c876bb880605504c66501fd9c8f49e49f71917ad6d152b7102"
Oct 30 21:34:06.258297 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:34:06.258274    5937 scope.go:122] "RemoveContainer" containerID="fa891fcb4353090a484c058e324b9c3043af7b78bfeb99eab6e88dac6ba487a5"
Oct 30 21:34:15.672210 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:34:15.672132    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:34:45.672191 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:34:45.672153    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:35:13.069609 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.069575    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"]
Oct 30 21:35:13.072923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.072907    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.078306 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.078274    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.078447 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.078344    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.078447 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.078428    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.078529 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.078480    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-config\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.078586 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.078554    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-test-logs-loki-secret\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.078635 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.078623    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxttq\" (UniqueName: \"kubernetes.io/projected/aba9e01c-e332-4024-bbfa-349d420cfe0b-kube-api-access-dxttq\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.126344 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.126313    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ca-bundle\""
Oct 30 21:35:13.176650 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.176625    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"test-logs-loki-secret\""
Oct 30 21:35:13.176829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.176690    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-dockercfg-4gxlb\""
Oct 30 21:35:13.176829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.176703    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-http\""
Oct 30 21:35:13.176829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.176764    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-config\""
Oct 30 21:35:13.176829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.176791    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-querier-grpc\""
Oct 30 21:35:13.177844 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.177829    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"]
Oct 30 21:35:13.179273 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.179252    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-test-logs-loki-secret\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.179397 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.179309    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxttq\" (UniqueName: \"kubernetes.io/projected/aba9e01c-e332-4024-bbfa-349d420cfe0b-kube-api-access-dxttq\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.179397 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.179364    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.179522 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.179412    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.179522 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.179445    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.179522 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.179494    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-config\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.180086 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.180057    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.180494 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.180466    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-config\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.181879 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.181851    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-http\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.182032 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.182015    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-grpc\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.182166 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.182147    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-test-logs-loki-secret\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.241730 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.241705    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxttq\" (UniqueName: \"kubernetes.io/projected/aba9e01c-e332-4024-bbfa-349d420cfe0b-kube-api-access-dxttq\") pod \"data-science-lokistack-querier-778ddf848f-jjmd9\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") " pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.384195 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.384110    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:13.755092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:13.755067    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"]
Oct 30 21:35:13.757892 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:35:13.757868    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaba9e01c_e332_4024_bbfa_349d420cfe0b.slice/crio-26dae4b69dd6b7aa5493c9346579148ae9ea0efc4a2191e9bf773ebd7b5324c1 WatchSource:0}: Error finding container 26dae4b69dd6b7aa5493c9346579148ae9ea0efc4a2191e9bf773ebd7b5324c1: Status 404 returned error can't find the container with id 26dae4b69dd6b7aa5493c9346579148ae9ea0efc4a2191e9bf773ebd7b5324c1
Oct 30 21:35:14.138918 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.138833    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9" event={"ID":"aba9e01c-e332-4024-bbfa-349d420cfe0b","Type":"ContainerStarted","Data":"ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340"}
Oct 30 21:35:14.138918 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.138874    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9" event={"ID":"aba9e01c-e332-4024-bbfa-349d420cfe0b","Type":"ContainerStarted","Data":"26dae4b69dd6b7aa5493c9346579148ae9ea0efc4a2191e9bf773ebd7b5324c1"}
Oct 30 21:35:14.139321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.138974    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:14.239281 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.239255    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"]
Oct 30 21:35:14.242882 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.242865    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.259618 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.259574    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9" podStartSLOduration=1.259559237 podStartE2EDuration="1.259559237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:14.258870356 +0000 UTC m=+3489.214885145" watchObservedRunningTime="2026-10-30 21:35:14.259559237 +0000 UTC m=+3489.215574006"
Oct 30 21:35:14.289158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.289135    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-lokistack-gateway\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.289297 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.289185    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tenants\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.289297 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.289207    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-rbac\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.289440 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.289352    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.289440 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.289399    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-ca-bundle\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.289590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.289455    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tls-secret\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.289590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.289568    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx8lm\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-kube-api-access-cx8lm\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.289711 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.289625    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-client-http\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.303071 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.303046    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"]
Oct 30 21:35:14.327160 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.327133    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway\""
Oct 30 21:35:14.327160 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.327142    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-ca-bundle\""
Oct 30 21:35:14.329038 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.329023    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-http\""
Oct 30 21:35:14.329176 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.329162    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway\""
Oct 30 21:35:14.329319 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.329302    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-client-http\""
Oct 30 21:35:14.329413 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.329398    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-gateway-dockercfg-stn89\""
Oct 30 21:35:14.390839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.390771    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tenants\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.390839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.390816    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-rbac\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.391068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.390843    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.391068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.390871    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-ca-bundle\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.391068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.390894    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tls-secret\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.391068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.390929    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8lm\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-kube-api-access-cx8lm\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.391068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.390970    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-client-http\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.391068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.391004    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-lokistack-gateway\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.391766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.391739    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.391871 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.391829    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-rbac\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.392027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.392001    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-lokistack-gateway\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.393610 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.393584    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-client-http\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.393837 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.393819    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tls-secret\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.394074 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.394058    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-ca-bundle\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.394117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.394079    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tenants\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.453653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.453629    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx8lm\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-kube-api-access-cx8lm\") pod \"data-science-lokistack-gateway-8656d54b6-dh7j2\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") " pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.557453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.557416    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:14.984068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:14.983924    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"]
Oct 30 21:35:14.986226 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:35:14.986195    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfecd9cfc_d055_4945_bbe5_c6266e9a8a06.slice/crio-d922d28545dd37b6cda087effd79ca02fe5192d7215f0a6b093141bb5e784bf7 WatchSource:0}: Error finding container d922d28545dd37b6cda087effd79ca02fe5192d7215f0a6b093141bb5e784bf7: Status 404 returned error can't find the container with id d922d28545dd37b6cda087effd79ca02fe5192d7215f0a6b093141bb5e784bf7
Oct 30 21:35:15.146081 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.145291    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2" event={"ID":"fecd9cfc-d055-4945-bbe5-c6266e9a8a06","Type":"ContainerStarted","Data":"b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8"}
Oct 30 21:35:15.146081 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.145354    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2" event={"ID":"fecd9cfc-d055-4945-bbe5-c6266e9a8a06","Type":"ContainerStarted","Data":"3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba"}
Oct 30 21:35:15.146081 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.145374    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2" event={"ID":"fecd9cfc-d055-4945-bbe5-c6266e9a8a06","Type":"ContainerStarted","Data":"d922d28545dd37b6cda087effd79ca02fe5192d7215f0a6b093141bb5e784bf7"}
Oct 30 21:35:15.146081 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.145398    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:15.146081 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.145595    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:15.151246 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.151225    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:15.154877 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.154859    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:35:15.270419 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.270331    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2" podStartSLOduration=1.270318592 podStartE2EDuration="1.270318592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:15.269301018 +0000 UTC m=+3490.225315820" watchObservedRunningTime="2026-10-30 21:35:15.270318592 +0000 UTC m=+3490.226333367"
Oct 30 21:35:15.315497 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.315472    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 21:35:15.318884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.318867    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.372504 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.372481    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-compactor-grpc\""
Oct 30 21:35:15.372688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.372675    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-compactor-http\""
Oct 30 21:35:15.381837 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.381817    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 21:35:15.502284 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.502257    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s65rr\" (UniqueName: \"kubernetes.io/projected/edc75104-4c13-48f9-86f2-91f760482048-kube-api-access-s65rr\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.502456 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.502313    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-config\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.502456 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.502347    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-http\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.502456 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.502415    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-grpc\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.502456 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.502445    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.502641 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.502468    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-test-logs-loki-secret\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.603151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.603081    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s65rr\" (UniqueName: \"kubernetes.io/projected/edc75104-4c13-48f9-86f2-91f760482048-kube-api-access-s65rr\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.603151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.603149    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-config\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.603381 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.603172    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-http\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.603381 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.603212    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-grpc\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.603381 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.603258    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.603381 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.603289    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-test-logs-loki-secret\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.604104 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.604081    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-config\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.604229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.604197    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.605871 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.605843    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-grpc\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.606075 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.606055    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-http\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.606145 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.606109    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-test-logs-loki-secret\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.665830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.665801    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s65rr\" (UniqueName: \"kubernetes.io/projected/edc75104-4c13-48f9-86f2-91f760482048-kube-api-access-s65rr\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:15.672503 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:35:15.672469    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:35:15.856223 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.856163    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-0"]
Oct 30 21:35:15.860660 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.860643    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:15.914167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.914150    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-http\""
Oct 30 21:35:15.914279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.914206    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-lokistack-ingester-grpc\""
Oct 30 21:35:15.919883 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:15.919861    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-0"]
Oct 30 21:35:16.207674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.207653    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.208093 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.207694    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-config\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.208093 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.207711    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-test-logs-loki-secret\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.208093 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.207830    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.208093 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.207894    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n9ng\" (UniqueName: \"kubernetes.io/projected/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-kube-api-access-2n9ng\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.208093 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.207984    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.308774 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.308743    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-config\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.308940 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.308776    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-test-logs-loki-secret\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.308940 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.308838    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.309064 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.308988    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9ng\" (UniqueName: \"kubernetes.io/projected/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-kube-api-access-2n9ng\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.309121 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.309066    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.309194 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.309170    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.309711 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.309682    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-config\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.310111 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.310089    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ca-bundle\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.311713 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.311684    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-http\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.311814 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.311792    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-test-logs-loki-secret\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.311979 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.311958    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-grpc\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:16.371703 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:16.371670    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n9ng\" (UniqueName: \"kubernetes.io/projected/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-kube-api-access-2n9ng\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:17.354757 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.354730    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-jwhmf"]
Oct 30 21:35:17.359343 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.359323    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.420732 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.420701    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-jwhmf"]
Oct 30 21:35:17.489376 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.489345    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-metrics\""
Oct 30 21:35:17.489526 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.489508    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-collector-dockercfg-hh4ns\""
Oct 30 21:35:17.489622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.489553    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-collector-token\""
Oct 30 21:35:17.492673 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.492659    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-logging\"/\"openshift-service-ca.crt\""
Oct 30 21:35:17.522911 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.522887    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-sa-token\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523036 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.522952    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65b81763-7817-453f-9e9d-16f479404e2d-tmp\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523036 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.523018    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4dp9\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-kube-api-access-v4dp9\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523129 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.523079    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-datadir\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523185 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.523167    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-trusted-ca\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523244 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.523232    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523302 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.523266    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523342 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.523333    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523389 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.523377    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-entrypoint\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.523401    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-varlogpods\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.523523 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.523462    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.529788 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.529767    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-logging\"/\"kube-root-ca.crt\""
Oct 30 21:35:17.529940 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.529926    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-config\""
Oct 30 21:35:17.581545 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.581518    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-logging\"/\"data-science-cluster-log-forwarder-trustbundle\""
Oct 30 21:35:17.624925 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.624896    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-datadir\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625070 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.624943    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-trusted-ca\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625070 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.624973    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625070 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625000    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625070 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625013    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-datadir\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625070 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625037    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625091    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-entrypoint\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625120    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-varlogpods\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625353 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:35:17.625130    5937 secret.go:189] Couldn't get secret openshift-logging/data-science-cluster-log-forwarder-metrics: secret "data-science-cluster-log-forwarder-metrics" not found
Oct 30 21:35:17.625353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625150    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625182    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-sa-token\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625353 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:35:17.625204    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics podName:65b81763-7817-453f-9e9d-16f479404e2d nodeName:}" failed. No retries permitted until 2026-10-30 21:35:18.125181419 +0000 UTC m=+3493.081196188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics" (UniqueName: "kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics") pod "data-science-cluster-log-forwarder-jwhmf" (UID: "65b81763-7817-453f-9e9d-16f479404e2d") : secret "data-science-cluster-log-forwarder-metrics" not found
Oct 30 21:35:17.625353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625220    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-varlogpods\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625274    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65b81763-7817-453f-9e9d-16f479404e2d-tmp\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.625353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.625296    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4dp9\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-kube-api-access-v4dp9\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.626139 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.626119    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-trusted-ca\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.626229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.626207    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-entrypoint\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.626286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.626255    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.626340 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.626285    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.628067 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.628042    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.628255 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.628231    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65b81763-7817-453f-9e9d-16f479404e2d-tmp\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.687384 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.687356    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-sa-token\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:17.687521 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:17.687475    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4dp9\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-kube-api-access-v4dp9\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:18.129767 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:18.129731    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:18.132115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:18.132096    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics\") pod \"data-science-cluster-log-forwarder-jwhmf\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") " pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:18.228142 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:18.228110    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-jwhmf"]
Oct 30 21:35:18.228367 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:18.228355    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:18.666259 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:18.666228    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-jwhmf"]
Oct 30 21:35:18.667284 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:35:18.667262    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b81763_7817_453f_9e9d_16f479404e2d.slice/crio-905f1e8d541c6038627b2caaa6c1ec744c8838b9020ec809cddb14468c841d48 WatchSource:0}: Error finding container 905f1e8d541c6038627b2caaa6c1ec744c8838b9020ec809cddb14468c841d48: Status 404 returned error can't find the container with id 905f1e8d541c6038627b2caaa6c1ec744c8838b9020ec809cddb14468c841d48
Oct 30 21:35:19.164357 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:19.164325    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf" event={"ID":"65b81763-7817-453f-9e9d-16f479404e2d","Type":"ContainerStarted","Data":"905f1e8d541c6038627b2caaa6c1ec744c8838b9020ec809cddb14468c841d48"}
Oct 30 21:35:20.956702 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:20.956663    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-15e08b96-1483-441a-b23e-f71f378d320b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:20.957138 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:20.956719    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:20.957138 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:20.956757    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.121016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.120984    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.121016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.121000    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.121016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.120994    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-15e08b96-1483-441a-b23e-f71f378d320b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") device path: \"\"" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:21.158343 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.158312    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.158500 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.158393    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-15e08b96-1483-441a-b23e-f71f378d320b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:21.158500 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.158429    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.158500 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.158465    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.158669 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.158510    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.158669 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.158515    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-15e08b96-1483-441a-b23e-f71f378d320b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:21.211894 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.211828    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") DevicePath \"csi-841ff7316bc20493f777778bb1b75fb4959885499ab232447c6f04ac452e1878\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.212078 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.212053    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") DevicePath \"csi-449db449f5083caccf1f54611cc314da97b72a473d33be59fafa5eab0caa75eb\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.212193 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.212119    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-15e08b96-1483-441a-b23e-f71f378d320b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") DevicePath \"csi-6a085d3e67a630a4214206895ff292e354af59b038e68fa08a9d0c8116604e7b\"" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:21.478962 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.478877    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/9e803e71aa1a321ca13db04a70163de7b235ec4d70d2f1a6a9454d22b36ea793/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.479880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.479851    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-15e08b96-1483-441a-b23e-f71f378d320b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/87689800b40a0507be9b5a7ccc8b30c88d712597fe437d9eeacc33487674d601/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:21.482077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.481697    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/cca65923646391fc1bfbce314e3ac098f570fd3312070cca30f30dc2e5738fbd/globalmount\"" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.548584 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.545684    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-15e08b96-1483-441a-b23e-f71f378d320b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") pod \"data-science-lokistack-compactor-0\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") " pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:21.548584 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.548492    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.551335 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.551297    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") pod \"data-science-lokistack-ingester-0\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") " pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:21.631461 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.631421    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:21.872768 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:21.872680    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:22.018997 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:22.018975    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 21:35:22.021083 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:35:22.021059    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedc75104_4c13_48f9_86f2_91f760482048.slice/crio-52bbb5d988260944561332f769e708934c7ab04230d7d170ff82d74d669326b4 WatchSource:0}: Error finding container 52bbb5d988260944561332f769e708934c7ab04230d7d170ff82d74d669326b4: Status 404 returned error can't find the container with id 52bbb5d988260944561332f769e708934c7ab04230d7d170ff82d74d669326b4
Oct 30 21:35:22.180411 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:22.180318    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" event={"ID":"edc75104-4c13-48f9-86f2-91f760482048","Type":"ContainerStarted","Data":"01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97"}
Oct 30 21:35:22.180411 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:22.180365    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" event={"ID":"edc75104-4c13-48f9-86f2-91f760482048","Type":"ContainerStarted","Data":"52bbb5d988260944561332f769e708934c7ab04230d7d170ff82d74d669326b4"}
Oct 30 21:35:22.180411 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:22.180398    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:22.255403 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:22.255368    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-0"]
Oct 30 21:35:22.260187 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:35:22.260160    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86c14d28_dc35_432a_a12a_7afc1cfbfc5d.slice/crio-3c264fe8e51e287f334cb380cd1d716ce4235c9acc92a45bc1f8043d5ed13084 WatchSource:0}: Error finding container 3c264fe8e51e287f334cb380cd1d716ce4235c9acc92a45bc1f8043d5ed13084: Status 404 returned error can't find the container with id 3c264fe8e51e287f334cb380cd1d716ce4235c9acc92a45bc1f8043d5ed13084
Oct 30 21:35:22.302560 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:22.302487    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" podStartSLOduration=9.302467108 podStartE2EDuration="9.302467108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:22.301620961 +0000 UTC m=+3497.257635737" watchObservedRunningTime="2026-10-30 21:35:22.302467108 +0000 UTC m=+3497.258481884"
Oct 30 21:35:23.186733 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:23.186694    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" event={"ID":"86c14d28-dc35-432a-a12a-7afc1cfbfc5d","Type":"ContainerStarted","Data":"0e67aafb1907c4211f5d8c34729e69fb07a0743568d091166aad7d59b8c77352"}
Oct 30 21:35:23.187189 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:23.186741    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" event={"ID":"86c14d28-dc35-432a-a12a-7afc1cfbfc5d","Type":"ContainerStarted","Data":"3c264fe8e51e287f334cb380cd1d716ce4235c9acc92a45bc1f8043d5ed13084"}
Oct 30 21:35:23.187189 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:23.186790    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:35:23.309252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:23.309194    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podStartSLOduration=11.309176133 podStartE2EDuration="11.309176133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:23.308716395 +0000 UTC m=+3498.264731185" watchObservedRunningTime="2026-10-30 21:35:23.309176133 +0000 UTC m=+3498.265190912"
Oct 30 21:35:25.202862 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.202824    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf" event={"ID":"65b81763-7817-453f-9e9d-16f479404e2d","Type":"ContainerStarted","Data":"362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428"}
Oct 30 21:35:25.203306 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.202897    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf" podUID="65b81763-7817-453f-9e9d-16f479404e2d" containerName="collector" containerID="cri-o://362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428" gracePeriod=10
Oct 30 21:35:25.378344 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.378280    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf" podStartSLOduration=2.86942547 podStartE2EDuration="8.378262571s" totalImagesPullingTime="5.508837101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:35:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:25.376818388 +0000 UTC m=+3500.332833164" watchObservedRunningTime="2026-10-30 21:35:25.378262571 +0000 UTC m=+3500.334277347"
Oct 30 21:35:25.451867 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.451843    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:25.605873 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.605832    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-entrypoint\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-entrypoint\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.605895    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-trusted-ca\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.605957    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-kube-api-access-v4dp9\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-kube-api-access-v4dp9\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606002    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65b81763-7817-453f-9e9d-16f479404e2d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/65b81763-7817-453f-9e9d-16f479404e2d-tmp\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606047    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config-openshift-service-cacrt\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606302 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606097    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606302 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606159    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606302 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606191    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-sa-token\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-sa-token\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606302 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606240    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-datadir\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-datadir\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606302 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606263    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-varlogpods\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-varlogpods\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606294    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-trusted-ca" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:35:25.606570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606332    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-data-science-cluster-log-forwarder-collector-token\") pod \"65b81763-7817-453f-9e9d-16f479404e2d\" (UID: \"65b81763-7817-453f-9e9d-16f479404e2d\") "
Oct 30 21:35:25.606570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606349    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-datadir" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "datadir". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Oct 30 21:35:25.606570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606389    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-varlogpods" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "varlogpods". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Oct 30 21:35:25.606808 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606639    5937 reconciler_common.go:299] "Volume detached for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-datadir\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.606808 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606656    5937 reconciler_common.go:299] "Volume detached for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/65b81763-7817-453f-9e9d-16f479404e2d-varlogpods\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.606808 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606670    5937 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-trusted-ca\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.606808 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606711    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:35:25.606808 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.606772    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config-openshift-service-cacrt" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "config-openshift-service-cacrt". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:35:25.609014 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.608974    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "metrics". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:35:25.609309 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.609278    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-data-science-cluster-log-forwarder-collector-token" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "data-science-cluster-log-forwarder-collector-token". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:35:25.609705 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.609671    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65b81763-7817-453f-9e9d-16f479404e2d-tmp" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:35:25.610957 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.610938    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-kube-api-access-v4dp9" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "kube-api-access-v4dp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:35:25.611037 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.610962    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-sa-token" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:35:25.615146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.615121    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-entrypoint" pod "65b81763-7817-453f-9e9d-16f479404e2d" (UID: "65b81763-7817-453f-9e9d-16f479404e2d"). InnerVolumeSpecName "entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:35:25.666016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.665987    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-2bsc2"]
Oct 30 21:35:25.666383 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.666371    5937 cpu_manager.go:414] "containerMap: removing container" podUID="65b81763-7817-453f-9e9d-16f479404e2d" containerName="collector"
Oct 30 21:35:25.666426 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.666386    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65b81763-7817-453f-9e9d-16f479404e2d" containerName="collector"
Oct 30 21:35:25.666462 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.666455    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="65b81763-7817-453f-9e9d-16f479404e2d" containerName="collector"
Oct 30 21:35:25.671000 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.670979    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.708130 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.708105    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-data-science-cluster-log-forwarder-collector-token\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.708252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.708131    5937 reconciler_common.go:299] "Volume detached for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-entrypoint\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.708252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.708147    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4dp9\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-kube-api-access-v4dp9\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.708252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.708161    5937 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65b81763-7817-453f-9e9d-16f479404e2d-tmp\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.708252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.708174    5937 reconciler_common.go:299] "Volume detached for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config-openshift-service-cacrt\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.708252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.708186    5937 reconciler_common.go:299] "Volume detached for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/65b81763-7817-453f-9e9d-16f479404e2d-metrics\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.708252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.708198    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/65b81763-7817-453f-9e9d-16f479404e2d-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.708252 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.708210    5937 reconciler_common.go:299] "Volume detached for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/65b81763-7817-453f-9e9d-16f479404e2d-sa-token\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:35:25.733148 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.733121    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-2bsc2"]
Oct 30 21:35:25.808970 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.808946    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-datadir\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.808993    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-entrypoint\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.809014    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809182 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.809150    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-metrics\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809231 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.809188    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-varlogpods\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809284 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.809231    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809342 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.809327    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-tmp\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809397 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.809365    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgrn9\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-kube-api-access-fgrn9\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809454 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.809401    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809454 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.809444    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-sa-token\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.809585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.809479    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-trusted-ca\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910276 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910198    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-metrics\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910276 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910259    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-varlogpods\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910295    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910326    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-tmp\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910355    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgrn9\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-kube-api-access-fgrn9\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910386    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910425    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-sa-token\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910452    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-trusted-ca\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910510    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-datadir\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910590    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-entrypoint\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.910839 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.910622    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.911262 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.911237    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config-openshift-service-cacrt\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.912424 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.911683    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-varlogpods\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.912424 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.912084    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-datadir\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.912424 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.912375    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-entrypoint\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.913385 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.912806    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-trusted-ca\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.913385 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.913341    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.914157 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.914136    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-metrics\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.914436 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.914421    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-tmp\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.914698 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.914678    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-data-science-cluster-log-forwarder-collector-token\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.975352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.975323    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-sa-token\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.977840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.977814    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgrn9\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-kube-api-access-fgrn9\") pod \"data-science-cluster-log-forwarder-2bsc2\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") " pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:25.984744 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:25.984721    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:35:26.210242 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.210210    5937 generic.go:356] "Generic (PLEG): container finished" podID="65b81763-7817-453f-9e9d-16f479404e2d" containerID="362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428" exitCode=0
Oct 30 21:35:26.210702 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.210262    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf"
Oct 30 21:35:26.210702 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.210272    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf" event={"ID":"65b81763-7817-453f-9e9d-16f479404e2d","Type":"ContainerDied","Data":"362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428"}
Oct 30 21:35:26.210702 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.210316    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-jwhmf" event={"ID":"65b81763-7817-453f-9e9d-16f479404e2d","Type":"ContainerDied","Data":"905f1e8d541c6038627b2caaa6c1ec744c8838b9020ec809cddb14468c841d48"}
Oct 30 21:35:26.210702 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.210345    5937 scope.go:122] "RemoveContainer" containerID="362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428"
Oct 30 21:35:26.220561 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.220515    5937 scope.go:122] "RemoveContainer" containerID="362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428"
Oct 30 21:35:26.220873 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:35:26.220845    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428\": container with ID starting with 362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428 not found: ID does not exist" containerID="362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428"
Oct 30 21:35:26.220942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.220883    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428"} err="failed to get container status \"362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428\": rpc error: code = NotFound desc = could not find container \"362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428\": container with ID starting with 362189d1e8d137ecd600b018b7607a4bc86707611d2616086f756ae6943de428 not found: ID does not exist"
Oct 30 21:35:26.377985 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.377957    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-jwhmf"]
Oct 30 21:35:26.382398 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.382374    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-jwhmf"]
Oct 30 21:35:26.410622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:26.410598    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-2bsc2"]
Oct 30 21:35:26.430294 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:35:26.430272    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07b7a39_a1b7_4862_b887_b9e2cd4f0da5.slice/crio-d13b248573304b9c7fe0dceae18ce5fd990a8356335c134cd0f82482a163519c WatchSource:0}: Error finding container d13b248573304b9c7fe0dceae18ce5fd990a8356335c134cd0f82482a163519c: Status 404 returned error can't find the container with id d13b248573304b9c7fe0dceae18ce5fd990a8356335c134cd0f82482a163519c
Oct 30 21:35:27.161427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:27.161395    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="65b81763-7817-453f-9e9d-16f479404e2d" path="/var/lib/kubelet/pods/65b81763-7817-453f-9e9d-16f479404e2d/volumes"
Oct 30 21:35:27.216646 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:27.216610    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2" event={"ID":"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5","Type":"ContainerStarted","Data":"cbf527cb16fc245e5c3f55eb23ebe5f3a7550ce6b906056450ad962a537c9ec3"}
Oct 30 21:35:27.217111 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:27.216666    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2" event={"ID":"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5","Type":"ContainerStarted","Data":"d13b248573304b9c7fe0dceae18ce5fd990a8356335c134cd0f82482a163519c"}
Oct 30 21:35:27.348740 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:27.348654    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2" podStartSLOduration=2.348640177 podStartE2EDuration="2.348640177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:27.345524263 +0000 UTC m=+3502.301539038" watchObservedRunningTime="2026-10-30 21:35:27.348640177 +0000 UTC m=+3502.304654952"
Oct 30 21:35:35.151669 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:35.151638    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:35:43.192873 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:43.192845    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:35:44.203253 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:44.203207    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:35:45.673190 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:35:45.673152    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:35:54.201163 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:35:54.201117    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:36:04.201282 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:04.201246    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:36:14.201555 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:14.201511    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:36:15.672914 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:36:15.672877    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:36:45.673168 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:36:45.673129    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:36:48.010995 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.010950    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"]
Oct 30 21:36:48.014406 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.014390    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.112432 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.112384    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otc-internal\") pod \"data-science-usage-logs-collector-59d48566db-b9spm\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.112634 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.112517    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otlp-tls-certs\") pod \"data-science-usage-logs-collector-59d48566db-b9spm\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.112755 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.112734    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bd5h\" (UniqueName: \"kubernetes.io/projected/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-kube-api-access-6bd5h\") pod \"data-science-usage-logs-collector-59d48566db-b9spm\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.119148 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.119116    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-dockercfg-2lrnh\""
Oct 30 21:36:48.119148 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.119140    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-headless-tls\""
Oct 30 21:36:48.119782 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.119765    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-collector-9d8884b6\""
Oct 30 21:36:48.164746 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.164713    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"]
Oct 30 21:36:48.213733 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.213697    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otlp-tls-certs\") pod \"data-science-usage-logs-collector-59d48566db-b9spm\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.213947 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.213796    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bd5h\" (UniqueName: \"kubernetes.io/projected/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-kube-api-access-6bd5h\") pod \"data-science-usage-logs-collector-59d48566db-b9spm\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.213947 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.213846    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otc-internal\") pod \"data-science-usage-logs-collector-59d48566db-b9spm\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.214478 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.214457    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otc-internal\") pod \"data-science-usage-logs-collector-59d48566db-b9spm\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.216437 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.216417    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otlp-tls-certs\") pod \"data-science-usage-logs-collector-59d48566db-b9spm\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.284508 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.284438    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bd5h\" (UniqueName: \"kubernetes.io/projected/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-kube-api-access-6bd5h\") pod \"data-science-usage-logs-collector-59d48566db-b9spm\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") " pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.328637 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.328602    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:36:48.706643 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.706601    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 21:36:48.706850 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.706809    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" podUID="edc75104-4c13-48f9-86f2-91f760482048" containerName="loki-compactor" containerID="cri-o://01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97" gracePeriod=30
Oct 30 21:36:48.711890 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.711863    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"]
Oct 30 21:36:48.750405 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.750376    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-0"]
Oct 30 21:36:48.750674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.750629    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" containerID="cri-o://0e67aafb1907c4211f5d8c34729e69fb07a0743568d091166aad7d59b8c77352" gracePeriod=600
Oct 30 21:36:48.753190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.752129    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:36:48.753190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.752206    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:36:48.764085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.764050    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"]
Oct 30 21:36:48.764284 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.764260    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9" podUID="aba9e01c-e332-4024-bbfa-349d420cfe0b" containerName="loki-querier" containerID="cri-o://ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340" gracePeriod=30
Oct 30 21:36:48.767802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.767328    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"]
Oct 30 21:36:48.767802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.767522    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2" podUID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerName="gateway" containerID="cri-o://3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba" gracePeriod=30
Oct 30 21:36:48.767802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:48.767720    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2" podUID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerName="opa" containerID="cri-o://b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8" gracePeriod=30
Oct 30 21:36:49.125026 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.124996    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:36:49.224372 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.224343    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-ca-bundle\") pod \"aba9e01c-e332-4024-bbfa-349d420cfe0b\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") "
Oct 30 21:36:49.224594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.224383    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-config\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-config\") pod \"aba9e01c-e332-4024-bbfa-349d420cfe0b\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") "
Oct 30 21:36:49.224594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.224420    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-grpc\") pod \"aba9e01c-e332-4024-bbfa-349d420cfe0b\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") "
Oct 30 21:36:49.224594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.224466    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-http\") pod \"aba9e01c-e332-4024-bbfa-349d420cfe0b\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") "
Oct 30 21:36:49.224594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.224528    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-test-logs-loki-secret\") pod \"aba9e01c-e332-4024-bbfa-349d420cfe0b\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") "
Oct 30 21:36:49.224851 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.224617    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aba9e01c-e332-4024-bbfa-349d420cfe0b-kube-api-access-dxttq\" (UniqueName: \"kubernetes.io/projected/aba9e01c-e332-4024-bbfa-349d420cfe0b-kube-api-access-dxttq\") pod \"aba9e01c-e332-4024-bbfa-349d420cfe0b\" (UID: \"aba9e01c-e332-4024-bbfa-349d420cfe0b\") "
Oct 30 21:36:49.224851 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.224826    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-config" pod "aba9e01c-e332-4024-bbfa-349d420cfe0b" (UID: "aba9e01c-e332-4024-bbfa-349d420cfe0b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.224963 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.224849    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-ca-bundle" pod "aba9e01c-e332-4024-bbfa-349d420cfe0b" (UID: "aba9e01c-e332-4024-bbfa-349d420cfe0b"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.225149 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.225056    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.225149 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.225081    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.227471 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.227427    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba9e01c-e332-4024-bbfa-349d420cfe0b-kube-api-access-dxttq" pod "aba9e01c-e332-4024-bbfa-349d420cfe0b" (UID: "aba9e01c-e332-4024-bbfa-349d420cfe0b"). InnerVolumeSpecName "kube-api-access-dxttq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:49.227628 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.227476    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-grpc" pod "aba9e01c-e332-4024-bbfa-349d420cfe0b" (UID: "aba9e01c-e332-4024-bbfa-349d420cfe0b"). InnerVolumeSpecName "data-science-lokistack-querier-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.227628 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.227577    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-http" pod "aba9e01c-e332-4024-bbfa-349d420cfe0b" (UID: "aba9e01c-e332-4024-bbfa-349d420cfe0b"). InnerVolumeSpecName "data-science-lokistack-querier-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.227763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.227695    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-test-logs-loki-secret" pod "aba9e01c-e332-4024-bbfa-349d420cfe0b" (UID: "aba9e01c-e332-4024-bbfa-349d420cfe0b"). InnerVolumeSpecName "test-logs-loki-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.326731 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.326701    5937 reconciler_common.go:299] "Volume detached for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-test-logs-loki-secret\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.326841 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.326738    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxttq\" (UniqueName: \"kubernetes.io/projected/aba9e01c-e332-4024-bbfa-349d420cfe0b-kube-api-access-dxttq\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.326841 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.326757    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-grpc\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-grpc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.326841 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.326774    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-querier-http\" (UniqueName: \"kubernetes.io/secret/aba9e01c-e332-4024-bbfa-349d420cfe0b-data-science-lokistack-querier-http\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.438372 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.438332    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-2bsc2"]
Oct 30 21:36:49.438565 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.438523    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2" podUID="c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" containerName="collector" containerID="cri-o://cbf527cb16fc245e5c3f55eb23ebe5f3a7550ce6b906056450ad962a537c9ec3" gracePeriod=10
Oct 30 21:36:49.470346 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.470325    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:36:49.528472 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.528405    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") pod \"edc75104-4c13-48f9-86f2-91f760482048\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") "
Oct 30 21:36:49.528472 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.528450    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/edc75104-4c13-48f9-86f2-91f760482048-kube-api-access-s65rr\" (UniqueName: \"kubernetes.io/projected/edc75104-4c13-48f9-86f2-91f760482048-kube-api-access-s65rr\") pod \"edc75104-4c13-48f9-86f2-91f760482048\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") "
Oct 30 21:36:49.528714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.528474    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-grpc\") pod \"edc75104-4c13-48f9-86f2-91f760482048\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") "
Oct 30 21:36:49.528714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.528508    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-http\") pod \"edc75104-4c13-48f9-86f2-91f760482048\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") "
Oct 30 21:36:49.528714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.528578    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-config\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-config\") pod \"edc75104-4c13-48f9-86f2-91f760482048\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") "
Oct 30 21:36:49.528714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.528631    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-test-logs-loki-secret\") pod \"edc75104-4c13-48f9-86f2-91f760482048\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") "
Oct 30 21:36:49.528714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.528678    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-ca-bundle\") pod \"edc75104-4c13-48f9-86f2-91f760482048\" (UID: \"edc75104-4c13-48f9-86f2-91f760482048\") "
Oct 30 21:36:49.529264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.529210    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-ca-bundle" pod "edc75104-4c13-48f9-86f2-91f760482048" (UID: "edc75104-4c13-48f9-86f2-91f760482048"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.529522 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.529487    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-config" pod "edc75104-4c13-48f9-86f2-91f760482048" (UID: "edc75104-4c13-48f9-86f2-91f760482048"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:49.531309 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.531287    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-http" pod "edc75104-4c13-48f9-86f2-91f760482048" (UID: "edc75104-4c13-48f9-86f2-91f760482048"). InnerVolumeSpecName "data-science-lokistack-compactor-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.531447 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.531415    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-grpc" pod "edc75104-4c13-48f9-86f2-91f760482048" (UID: "edc75104-4c13-48f9-86f2-91f760482048"). InnerVolumeSpecName "data-science-lokistack-compactor-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.531555 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.531517    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc75104-4c13-48f9-86f2-91f760482048-kube-api-access-s65rr" pod "edc75104-4c13-48f9-86f2-91f760482048" (UID: "edc75104-4c13-48f9-86f2-91f760482048"). InnerVolumeSpecName "kube-api-access-s65rr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:49.531803 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.531779    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-test-logs-loki-secret" pod "edc75104-4c13-48f9-86f2-91f760482048" (UID: "edc75104-4c13-48f9-86f2-91f760482048"). InnerVolumeSpecName "test-logs-loki-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:49.532123 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.532105    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80" pod "edc75104-4c13-48f9-86f2-91f760482048" (UID: "edc75104-4c13-48f9-86f2-91f760482048"). InnerVolumeSpecName "pvc-15e08b96-1483-441a-b23e-f71f378d320b". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:36:49.610158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.610121    5937 generic.go:356] "Generic (PLEG): container finished" podID="edc75104-4c13-48f9-86f2-91f760482048" containerID="01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97" exitCode=0
Oct 30 21:36:49.610311 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.610188    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0"
Oct 30 21:36:49.610311 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.610206    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" event={"ID":"edc75104-4c13-48f9-86f2-91f760482048","Type":"ContainerDied","Data":"01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97"}
Oct 30 21:36:49.610311 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.610260    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-compactor-0" event={"ID":"edc75104-4c13-48f9-86f2-91f760482048","Type":"ContainerDied","Data":"52bbb5d988260944561332f769e708934c7ab04230d7d170ff82d74d669326b4"}
Oct 30 21:36:49.610311 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.610285    5937 scope.go:122] "RemoveContainer" containerID="01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97"
Oct 30 21:36:49.611996 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.611971    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm" event={"ID":"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1","Type":"ContainerStarted","Data":"39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59"}
Oct 30 21:36:49.612121 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.612051    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm" event={"ID":"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1","Type":"ContainerStarted","Data":"8184e64cbf7766c63c73732a09dc99bf00dc4a1f59824408e235d11e30e7c41d"}
Oct 30 21:36:49.614030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.614009    5937 generic.go:356] "Generic (PLEG): container finished" podID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerID="b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8" exitCode=0
Oct 30 21:36:49.614149 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.614078    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2" event={"ID":"fecd9cfc-d055-4945-bbe5-c6266e9a8a06","Type":"ContainerDied","Data":"b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8"}
Oct 30 21:36:49.615465 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.615436    5937 generic.go:356] "Generic (PLEG): container finished" podID="aba9e01c-e332-4024-bbfa-349d420cfe0b" containerID="ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340" exitCode=0
Oct 30 21:36:49.615612 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.615470    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9" event={"ID":"aba9e01c-e332-4024-bbfa-349d420cfe0b","Type":"ContainerDied","Data":"ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340"}
Oct 30 21:36:49.615612 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.615480    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"
Oct 30 21:36:49.615612 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.615505    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9" event={"ID":"aba9e01c-e332-4024-bbfa-349d420cfe0b","Type":"ContainerDied","Data":"26dae4b69dd6b7aa5493c9346579148ae9ea0efc4a2191e9bf773ebd7b5324c1"}
Oct 30 21:36:49.620948 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.620931    5937 scope.go:122] "RemoveContainer" containerID="01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97"
Oct 30 21:36:49.621189 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:36:49.621167    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97\": container with ID starting with 01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97 not found: ID does not exist" containerID="01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97"
Oct 30 21:36:49.621241 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.621196    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97"} err="failed to get container status \"01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97\": rpc error: code = NotFound desc = could not find container \"01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97\": container with ID starting with 01d1b00eb668070f1b885745b8d9a0529380a26bee3b784b0ca12f6ea6cf5a97 not found: ID does not exist"
Oct 30 21:36:49.621241 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.621217    5937 scope.go:122] "RemoveContainer" containerID="ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340"
Oct 30 21:36:49.629926 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.629904    5937 reconciler_common.go:299] "Volume detached for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-test-logs-loki-secret\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.630051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.629931    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.630051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.629961    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-15e08b96-1483-441a-b23e-f71f378d320b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:36:49.630051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.629976    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s65rr\" (UniqueName: \"kubernetes.io/projected/edc75104-4c13-48f9-86f2-91f760482048-kube-api-access-s65rr\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.630051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.629994    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-compactor-grpc\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-grpc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.630051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.630008    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-compactor-http\" (UniqueName: \"kubernetes.io/secret/edc75104-4c13-48f9-86f2-91f760482048-data-science-lokistack-compactor-http\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.630051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.630040    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/edc75104-4c13-48f9-86f2-91f760482048-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:49.630331 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.630315    5937 scope.go:122] "RemoveContainer" containerID="ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340"
Oct 30 21:36:49.630603 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:36:49.630586    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340\": container with ID starting with ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340 not found: ID does not exist" containerID="ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340"
Oct 30 21:36:49.630668 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.630608    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340"} err="failed to get container status \"ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340\": rpc error: code = NotFound desc = could not find container \"ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340\": container with ID starting with ff1759998ee7f01c64da6a129cba650ece5f8b4582e6911841a0fdd756e0e340 not found: ID does not exist"
Oct 30 21:36:49.639286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.639273    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-15e08b96-1483-441a-b23e-f71f378d320b" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:36:49.730987 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.730954    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-15e08b96-1483-441a-b23e-f71f378d320b\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b972b7023164df80\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-6a085d3e67a630a4214206895ff292e354af59b038e68fa08a9d0c8116604e7b\""
Oct 30 21:36:49.807906 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.807824    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"]
Oct 30 21:36:49.815358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.815330    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-querier-778ddf848f-jjmd9"]
Oct 30 21:36:49.929752 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.929722    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 21:36:49.935804 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:49.935778    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-compactor-0"]
Oct 30 21:36:50.017271 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.017246    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:36:50.034439 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.034416    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-client-http\") pod \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") "
Oct 30 21:36:50.034599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.034461    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tenants\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tenants\") pod \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") "
Oct 30 21:36:50.034599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.034500    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tls-secret\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tls-secret\") pod \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") "
Oct 30 21:36:50.034599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.034528    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-rbac\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-rbac\") pod \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") "
Oct 30 21:36:50.034599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.034574    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-kube-api-access-cx8lm\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-kube-api-access-cx8lm\") pod \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") "
Oct 30 21:36:50.034781 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.034693    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-ca-bundle\") pod \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") "
Oct 30 21:36:50.034781 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.034756    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-ca-bundle\") pod \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") "
Oct 30 21:36:50.034894 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.034818    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-lokistack-gateway\") pod \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\" (UID: \"fecd9cfc-d055-4945-bbe5-c6266e9a8a06\") "
Oct 30 21:36:50.035146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.035100    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-ca-bundle" pod "fecd9cfc-d055-4945-bbe5-c6266e9a8a06" (UID: "fecd9cfc-d055-4945-bbe5-c6266e9a8a06"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:50.035650 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.035367    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.037169 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.037144    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-ca-bundle" pod "fecd9cfc-d055-4945-bbe5-c6266e9a8a06" (UID: "fecd9cfc-d055-4945-bbe5-c6266e9a8a06"). InnerVolumeSpecName "data-science-lokistack-gateway-ca-bundle". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:50.037321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.037300    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-client-http" pod "fecd9cfc-d055-4945-bbe5-c6266e9a8a06" (UID: "fecd9cfc-d055-4945-bbe5-c6266e9a8a06"). InnerVolumeSpecName "data-science-lokistack-gateway-client-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:50.037371 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.037323    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tls-secret" pod "fecd9cfc-d055-4945-bbe5-c6266e9a8a06" (UID: "fecd9cfc-d055-4945-bbe5-c6266e9a8a06"). InnerVolumeSpecName "tls-secret". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:50.037494 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.037478    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-kube-api-access-cx8lm" pod "fecd9cfc-d055-4945-bbe5-c6266e9a8a06" (UID: "fecd9cfc-d055-4945-bbe5-c6266e9a8a06"). InnerVolumeSpecName "kube-api-access-cx8lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:50.040625 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.040606    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-rbac" pod "fecd9cfc-d055-4945-bbe5-c6266e9a8a06" (UID: "fecd9cfc-d055-4945-bbe5-c6266e9a8a06"). InnerVolumeSpecName "rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:50.042009 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.041988    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-lokistack-gateway" pod "fecd9cfc-d055-4945-bbe5-c6266e9a8a06" (UID: "fecd9cfc-d055-4945-bbe5-c6266e9a8a06"). InnerVolumeSpecName "lokistack-gateway". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:50.043413 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.043395    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tenants" pod "fecd9cfc-d055-4945-bbe5-c6266e9a8a06" (UID: "fecd9cfc-d055-4945-bbe5-c6266e9a8a06"). InnerVolumeSpecName "tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:50.136714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.136636    5937 reconciler_common.go:299] "Volume detached for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-rbac\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.136714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.136666    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx8lm\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-kube-api-access-cx8lm\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.136714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.136680    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.136714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.136696    5937 reconciler_common.go:299] "Volume detached for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-lokistack-gateway\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.136714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.136708    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-data-science-lokistack-gateway-client-http\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.137387 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.136723    5937 reconciler_common.go:299] "Volume detached for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tenants\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.137387 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.136734    5937 reconciler_common.go:299] "Volume detached for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/fecd9cfc-d055-4945-bbe5-c6266e9a8a06-tls-secret\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:50.219461 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.219394    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm" podStartSLOduration=3.219373379 podStartE2EDuration="3.219373379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:50.072883765 +0000 UTC m=+3585.028898541" watchObservedRunningTime="2026-10-30 21:36:50.219373379 +0000 UTC m=+3585.175388157"
Oct 30 21:36:50.624275 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.624237    5937 generic.go:356] "Generic (PLEG): container finished" podID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerID="3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba" exitCode=0
Oct 30 21:36:50.624425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.624285    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"
Oct 30 21:36:50.624425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.624332    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2" event={"ID":"fecd9cfc-d055-4945-bbe5-c6266e9a8a06","Type":"ContainerDied","Data":"3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba"}
Oct 30 21:36:50.624425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.624369    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2" event={"ID":"fecd9cfc-d055-4945-bbe5-c6266e9a8a06","Type":"ContainerDied","Data":"d922d28545dd37b6cda087effd79ca02fe5192d7215f0a6b093141bb5e784bf7"}
Oct 30 21:36:50.624425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.624389    5937 scope.go:122] "RemoveContainer" containerID="b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8"
Oct 30 21:36:50.633038 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.633022    5937 scope.go:122] "RemoveContainer" containerID="3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba"
Oct 30 21:36:50.640953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.640936    5937 scope.go:122] "RemoveContainer" containerID="b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8"
Oct 30 21:36:50.641207 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:36:50.641187    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8\": container with ID starting with b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8 not found: ID does not exist" containerID="b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8"
Oct 30 21:36:50.641264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.641213    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8"} err="failed to get container status \"b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8\": rpc error: code = NotFound desc = could not find container \"b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8\": container with ID starting with b0690ea8100d6989765176b60581436640683a5dded49a5b35154bc3e057e1f8 not found: ID does not exist"
Oct 30 21:36:50.641264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.641227    5937 scope.go:122] "RemoveContainer" containerID="3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba"
Oct 30 21:36:50.641464 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:36:50.641450    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba\": container with ID starting with 3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba not found: ID does not exist" containerID="3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba"
Oct 30 21:36:50.641509 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.641466    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba"} err="failed to get container status \"3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba\": rpc error: code = NotFound desc = could not find container \"3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba\": container with ID starting with 3f2fa7023018a5a725403adbf9135fe97656eb976e53fd8f9e6271b4d18fc6ba not found: ID does not exist"
Oct 30 21:36:50.810203 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.810172    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"]
Oct 30 21:36:50.813802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:50.813781    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-gateway-8656d54b6-dh7j2"]
Oct 30 21:36:51.161647 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:51.161614    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aba9e01c-e332-4024-bbfa-349d420cfe0b" path="/var/lib/kubelet/pods/aba9e01c-e332-4024-bbfa-349d420cfe0b/volumes"
Oct 30 21:36:51.162074 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:51.162030    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="edc75104-4c13-48f9-86f2-91f760482048" path="/var/lib/kubelet/pods/edc75104-4c13-48f9-86f2-91f760482048/volumes"
Oct 30 21:36:51.162367 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:51.162354    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" path="/var/lib/kubelet/pods/fecd9cfc-d055-4945-bbe5-c6266e9a8a06/volumes"
Oct 30 21:36:54.201178 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:54.201143    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:36:59.511764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.511731    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"]
Oct 30 21:36:59.512125 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.511898    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0" podUID="b2a37c64-507c-400a-a453-02cabf5328eb" containerName="loki-index-gateway" containerID="cri-o://35ce4a9321a136746fb83d14f2aa99744f2f3b8c4cd1c7a2f72ff15cf4937f5b" gracePeriod=30
Oct 30 21:36:59.667239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.667213    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-logging_data-science-cluster-log-forwarder-2bsc2_c07b7a39-a1b7-4862-b887-b9e2cd4f0da5/collector/0.log"
Oct 30 21:36:59.667399 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.667250    5937 generic.go:356] "Generic (PLEG): container finished" podID="c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" containerID="cbf527cb16fc245e5c3f55eb23ebe5f3a7550ce6b906056450ad962a537c9ec3" exitCode=137
Oct 30 21:36:59.667399 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.667295    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2" event={"ID":"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5","Type":"ContainerDied","Data":"cbf527cb16fc245e5c3f55eb23ebe5f3a7550ce6b906056450ad962a537c9ec3"}
Oct 30 21:36:59.669032 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.669005    5937 generic.go:356] "Generic (PLEG): container finished" podID="b2a37c64-507c-400a-a453-02cabf5328eb" containerID="35ce4a9321a136746fb83d14f2aa99744f2f3b8c4cd1c7a2f72ff15cf4937f5b" exitCode=0
Oct 30 21:36:59.669144 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.669066    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0" event={"ID":"b2a37c64-507c-400a-a453-02cabf5328eb","Type":"ContainerDied","Data":"35ce4a9321a136746fb83d14f2aa99744f2f3b8c4cd1c7a2f72ff15cf4937f5b"}
Oct 30 21:36:59.773893 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.773867    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:36:59.827552 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.827514    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-grpc\") pod \"b2a37c64-507c-400a-a453-02cabf5328eb\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") "
Oct 30 21:36:59.827689 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.827619    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-config\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-config\") pod \"b2a37c64-507c-400a-a453-02cabf5328eb\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") "
Oct 30 21:36:59.827689 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.827665    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-http\") pod \"b2a37c64-507c-400a-a453-02cabf5328eb\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") "
Oct 30 21:36:59.827794 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.827692    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-ca-bundle\") pod \"b2a37c64-507c-400a-a453-02cabf5328eb\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") "
Oct 30 21:36:59.827794 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.827739    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2a37c64-507c-400a-a453-02cabf5328eb-kube-api-access-t8zkm\" (UniqueName: \"kubernetes.io/projected/b2a37c64-507c-400a-a453-02cabf5328eb-kube-api-access-t8zkm\") pod \"b2a37c64-507c-400a-a453-02cabf5328eb\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") "
Oct 30 21:36:59.827894 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.827805    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-test-usage-logs-loki-secret\") pod \"b2a37c64-507c-400a-a453-02cabf5328eb\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") "
Oct 30 21:36:59.827951 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.827915    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") pod \"b2a37c64-507c-400a-a453-02cabf5328eb\" (UID: \"b2a37c64-507c-400a-a453-02cabf5328eb\") "
Oct 30 21:36:59.828842 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.828772    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-config" pod "b2a37c64-507c-400a-a453-02cabf5328eb" (UID: "b2a37c64-507c-400a-a453-02cabf5328eb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:59.829140 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.829113    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-ca-bundle" pod "b2a37c64-507c-400a-a453-02cabf5328eb" (UID: "b2a37c64-507c-400a-a453-02cabf5328eb"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:36:59.829920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.829898    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:59.830020 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.829925    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:59.831589 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.830103    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-grpc" pod "b2a37c64-507c-400a-a453-02cabf5328eb" (UID: "b2a37c64-507c-400a-a453-02cabf5328eb"). InnerVolumeSpecName "data-science-usage-logs-lokistack-index-gateway-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:59.831589 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.830519    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-http" pod "b2a37c64-507c-400a-a453-02cabf5328eb" (UID: "b2a37c64-507c-400a-a453-02cabf5328eb"). InnerVolumeSpecName "data-science-usage-logs-lokistack-index-gateway-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:59.831589 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.831185    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-test-usage-logs-loki-secret" pod "b2a37c64-507c-400a-a453-02cabf5328eb" (UID: "b2a37c64-507c-400a-a453-02cabf5328eb"). InnerVolumeSpecName "test-usage-logs-loki-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:36:59.831589 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.831462    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2a37c64-507c-400a-a453-02cabf5328eb-kube-api-access-t8zkm" pod "b2a37c64-507c-400a-a453-02cabf5328eb" (UID: "b2a37c64-507c-400a-a453-02cabf5328eb"). InnerVolumeSpecName "kube-api-access-t8zkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:36:59.840088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.840068    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751" pod "b2a37c64-507c-400a-a453-02cabf5328eb" (UID: "b2a37c64-507c-400a-a453-02cabf5328eb"). InnerVolumeSpecName "pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:36:59.930944 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.930913    5937 reconciler_common.go:299] "Volume detached for volume \"test-usage-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-test-usage-logs-loki-secret\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:59.931100 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.930969    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:36:59.931100 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.930986    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-index-gateway-grpc\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-grpc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:59.931100 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.931000    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-index-gateway-http\" (UniqueName: \"kubernetes.io/secret/b2a37c64-507c-400a-a453-02cabf5328eb-data-science-usage-logs-lokistack-index-gateway-http\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:59.931100 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.931014    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8zkm\" (UniqueName: \"kubernetes.io/projected/b2a37c64-507c-400a-a453-02cabf5328eb-kube-api-access-t8zkm\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:36:59.942824 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:36:59.942804    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:37:00.031701 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.031674    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-2384f338-0932-4bc9-a23a-67c67aa8f5bf\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0b4268862ca575751\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-1555c7da07e14bc565211747225679e1cc79e7847b06e88c78b2ca29051ed84d\""
Oct 30 21:37:00.075562 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.075513    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-logging_data-science-cluster-log-forwarder-2bsc2_c07b7a39-a1b7-4862-b887-b9e2cd4f0da5/collector/0.log"
Oct 30 21:37:00.077822 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.077800    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:37:00.131989 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.131962    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-kube-api-access-fgrn9\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-kube-api-access-fgrn9\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132129 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.131999    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-entrypoint\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-entrypoint\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132129 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132037    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-metrics\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-metrics\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132129 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132063    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config-openshift-service-cacrt\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132129 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132089    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132356 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132134    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-data-science-cluster-log-forwarder-collector-token\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132356 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132202    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-sa-token\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-sa-token\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132356 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132257    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-datadir\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-datadir\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132356 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132285    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-tmp\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132356 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132317    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-trusted-ca\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132380    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-varlogpods\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-varlogpods\") pod \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\" (UID: \"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5\") "
Oct 30 21:37:00.132736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132489    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config-openshift-service-cacrt" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "config-openshift-service-cacrt". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:00.132736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132564    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-varlogpods" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "varlogpods". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Oct 30 21:37:00.132736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132601    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-datadir" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "datadir". PluginName "kubernetes.io/host-path", VolumeGIDValue ""
Oct 30 21:37:00.133038 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132932    5937 reconciler_common.go:299] "Volume detached for volume \"varlogpods\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-varlogpods\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.133038 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132951    5937 reconciler_common.go:299] "Volume detached for volume \"config-openshift-service-cacrt\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config-openshift-service-cacrt\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.133038 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.132967    5937 reconciler_common.go:299] "Volume detached for volume \"datadir\" (UniqueName: \"kubernetes.io/host-path/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-datadir\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.133206 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.133188    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:00.133269 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.133235    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-trusted-ca" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:00.134557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.134511    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-kube-api-access-fgrn9" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "kube-api-access-fgrn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:00.134823 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.134809    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-metrics" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "metrics". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:00.135099 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.135073    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-sa-token" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:00.135270 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.135243    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-data-science-cluster-log-forwarder-collector-token" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "data-science-cluster-log-forwarder-collector-token". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:00.135397 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.135382    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-tmp" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:37:00.137560 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.137526    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-entrypoint" pod "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" (UID: "c07b7a39-a1b7-4862-b887-b9e2cd4f0da5"). InnerVolumeSpecName "entrypoint". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:00.233809 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.233777    5937 reconciler_common.go:299] "Volume detached for volume \"sa-token\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-sa-token\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.233809 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.233802    5937 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-tmp\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.233809 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.233811    5937 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-trusted-ca\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.234007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.233823    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgrn9\" (UniqueName: \"kubernetes.io/projected/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-kube-api-access-fgrn9\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.234007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.233833    5937 reconciler_common.go:299] "Volume detached for volume \"entrypoint\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-entrypoint\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.234007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.233841    5937 reconciler_common.go:299] "Volume detached for volume \"metrics\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-metrics\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.234007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.233850    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.234007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.233859    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-cluster-log-forwarder-collector-token\" (UniqueName: \"kubernetes.io/secret/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5-data-science-cluster-log-forwarder-collector-token\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:00.676085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.676052    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"
Oct 30 21:37:00.676085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.676068    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0" event={"ID":"b2a37c64-507c-400a-a453-02cabf5328eb","Type":"ContainerDied","Data":"7186570807c27239702526570969bc5324ca3ab68f85ffdcbb58039f1cc1594b"}
Oct 30 21:37:00.676622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.676123    5937 scope.go:122] "RemoveContainer" containerID="35ce4a9321a136746fb83d14f2aa99744f2f3b8c4cd1c7a2f72ff15cf4937f5b"
Oct 30 21:37:00.677840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.677809    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-logging_data-science-cluster-log-forwarder-2bsc2_c07b7a39-a1b7-4862-b887-b9e2cd4f0da5/collector/0.log"
Oct 30 21:37:00.677940 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.677891    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2" event={"ID":"c07b7a39-a1b7-4862-b887-b9e2cd4f0da5","Type":"ContainerDied","Data":"d13b248573304b9c7fe0dceae18ce5fd990a8356335c134cd0f82482a163519c"}
Oct 30 21:37:00.677940 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.677927    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-logging/data-science-cluster-log-forwarder-2bsc2"
Oct 30 21:37:00.685644 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.685628    5937 scope.go:122] "RemoveContainer" containerID="cbf527cb16fc245e5c3f55eb23ebe5f3a7550ce6b906056450ad962a537c9ec3"
Oct 30 21:37:00.842699 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.842673    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-2bsc2"]
Oct 30 21:37:00.893157 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:00.893129    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-logging/data-science-cluster-log-forwarder-2bsc2"]
Oct 30 21:37:01.004957 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:01.004931    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"]
Oct 30 21:37:01.009646 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:01.009629    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-index-gateway-0"]
Oct 30 21:37:01.160479 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:01.160420    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2a37c64-507c-400a-a453-02cabf5328eb" path="/var/lib/kubelet/pods/b2a37c64-507c-400a-a453-02cabf5328eb/volumes"
Oct 30 21:37:01.160854 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:01.160839    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" path="/var/lib/kubelet/pods/c07b7a39-a1b7-4862-b887-b9e2cd4f0da5/volumes"
Oct 30 21:37:03.114867 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.114840    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"]
Oct 30 21:37:03.115308 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.115024    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm" podUID="e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1" containerName="otc-container" containerID="cri-o://39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59" gracePeriod=30
Oct 30 21:37:03.370156 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.370103    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:37:03.461269 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.461237    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otc-internal\" (UniqueName: \"kubernetes.io/configmap/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otc-internal\") pod \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") "
Oct 30 21:37:03.461438 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.461322    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otlp-tls-certs\") pod \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") "
Oct 30 21:37:03.461438 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.461354    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-kube-api-access-6bd5h\" (UniqueName: \"kubernetes.io/projected/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-kube-api-access-6bd5h\") pod \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\" (UID: \"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1\") "
Oct 30 21:37:03.461669 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.461649    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otc-internal" pod "e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1" (UID: "e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:03.463486 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.463466    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otlp-tls-certs" pod "e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1" (UID: "e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:03.463682 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.463662    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-kube-api-access-6bd5h" pod "e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1" (UID: "e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1"). InnerVolumeSpecName "kube-api-access-6bd5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:03.563077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.563049    5937 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otc-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:03.563077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.563076    5937 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-otlp-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:03.563077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.563087    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bd5h\" (UniqueName: \"kubernetes.io/projected/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1-kube-api-access-6bd5h\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:03.694691 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.694607    5937 generic.go:356] "Generic (PLEG): container finished" podID="e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1" containerID="39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59" exitCode=0
Oct 30 21:37:03.694691 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.694663    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"
Oct 30 21:37:03.694691 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.694682    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm" event={"ID":"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1","Type":"ContainerDied","Data":"39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59"}
Oct 30 21:37:03.694930 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.694735    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm" event={"ID":"e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1","Type":"ContainerDied","Data":"8184e64cbf7766c63c73732a09dc99bf00dc4a1f59824408e235d11e30e7c41d"}
Oct 30 21:37:03.694930 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.694766    5937 scope.go:122] "RemoveContainer" containerID="39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59"
Oct 30 21:37:03.703954 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.703932    5937 scope.go:122] "RemoveContainer" containerID="39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59"
Oct 30 21:37:03.704209 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:03.704187    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59\": container with ID starting with 39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59 not found: ID does not exist" containerID="39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59"
Oct 30 21:37:03.704286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.704216    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59"} err="failed to get container status \"39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59\": rpc error: code = NotFound desc = could not find container \"39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59\": container with ID starting with 39c46910f673c568e72b3bd5daec9dc670f05e1c326e6cab8ffeaa516ffd8d59 not found: ID does not exist"
Oct 30 21:37:03.872128 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.872103    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"]
Oct 30 21:37:03.880558 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:03.880515    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-collector-59d48566db-b9spm"]
Oct 30 21:37:04.201639 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:04.201604    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:37:05.162758 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:05.162728    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1" path="/var/lib/kubelet/pods/e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1/volumes"
Oct 30 21:37:07.150264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:07.150229    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"]
Oct 30 21:37:07.150761 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:07.150409    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb" podUID="219f0034-c3e2-45a8-8ce6-420ad6711335" containerName="loki-distributor" containerID="cri-o://99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216" gracePeriod=30
Oct 30 21:37:07.160897 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:07.160876    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"]
Oct 30 21:37:07.161072 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:07.161048    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" podUID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerName="gateway" containerID="cri-o://af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe" gracePeriod=30
Oct 30 21:37:07.161122 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:07.161071    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" podUID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerName="opa" containerID="cri-o://4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1" gracePeriod=30
Oct 30 21:37:07.719098 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:07.719069    5937 generic.go:356] "Generic (PLEG): container finished" podID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerID="4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1" exitCode=0
Oct 30 21:37:07.719218 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:07.719143    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" event={"ID":"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c","Type":"ContainerDied","Data":"4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1"}
Oct 30 21:37:07.910262 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:07.910206    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:37:08.002248 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.002221    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-http\") pod \"219f0034-c3e2-45a8-8ce6-420ad6711335\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") "
Oct 30 21:37:08.002425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.002273    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-config\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-config\") pod \"219f0034-c3e2-45a8-8ce6-420ad6711335\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") "
Oct 30 21:37:08.002425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.002305    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-ca-bundle\") pod \"219f0034-c3e2-45a8-8ce6-420ad6711335\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") "
Oct 30 21:37:08.002425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.002392    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/219f0034-c3e2-45a8-8ce6-420ad6711335-kube-api-access-bxjbd\" (UniqueName: \"kubernetes.io/projected/219f0034-c3e2-45a8-8ce6-420ad6711335-kube-api-access-bxjbd\") pod \"219f0034-c3e2-45a8-8ce6-420ad6711335\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") "
Oct 30 21:37:08.002620 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.002430    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-grpc\") pod \"219f0034-c3e2-45a8-8ce6-420ad6711335\" (UID: \"219f0034-c3e2-45a8-8ce6-420ad6711335\") "
Oct 30 21:37:08.002765 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.002725    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-config" pod "219f0034-c3e2-45a8-8ce6-420ad6711335" (UID: "219f0034-c3e2-45a8-8ce6-420ad6711335"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:08.002895 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.002790    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-ca-bundle" pod "219f0034-c3e2-45a8-8ce6-420ad6711335" (UID: "219f0034-c3e2-45a8-8ce6-420ad6711335"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:08.004719 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.004696    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-grpc" pod "219f0034-c3e2-45a8-8ce6-420ad6711335" (UID: "219f0034-c3e2-45a8-8ce6-420ad6711335"). InnerVolumeSpecName "data-science-usage-logs-lokistack-distributor-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:08.004805 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.004711    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/219f0034-c3e2-45a8-8ce6-420ad6711335-kube-api-access-bxjbd" pod "219f0034-c3e2-45a8-8ce6-420ad6711335" (UID: "219f0034-c3e2-45a8-8ce6-420ad6711335"). InnerVolumeSpecName "kube-api-access-bxjbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:08.004805 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.004740    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-http" pod "219f0034-c3e2-45a8-8ce6-420ad6711335" (UID: "219f0034-c3e2-45a8-8ce6-420ad6711335"). InnerVolumeSpecName "data-science-usage-logs-lokistack-distributor-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:08.103451 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.103424    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxjbd\" (UniqueName: \"kubernetes.io/projected/219f0034-c3e2-45a8-8ce6-420ad6711335-kube-api-access-bxjbd\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.103451 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.103447    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-distributor-grpc\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-grpc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.103451 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.103457    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-distributor-http\" (UniqueName: \"kubernetes.io/secret/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-distributor-http\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.103692 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.103467    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.103692 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.103477    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/219f0034-c3e2-45a8-8ce6-420ad6711335-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.410953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.410931    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:37:08.507585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.507503    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-ca-bundle\") pod \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") "
Oct 30 21:37:08.507585 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.507580    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") "
Oct 30 21:37:08.507752 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.507630    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-kube-api-access-24zw5\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-kube-api-access-24zw5\") pod \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") "
Oct 30 21:37:08.507752 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.507671    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-client-http\") pod \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") "
Oct 30 21:37:08.507752 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.507716    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-lokistack-gateway\") pod \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") "
Oct 30 21:37:08.507928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.507764    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac\") pod \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") "
Oct 30 21:37:08.507928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.507799    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret\") pod \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") "
Oct 30 21:37:08.507928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.507836    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tenants\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tenants\") pod \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") "
Oct 30 21:37:08.507928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.507854    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-ca-bundle" pod "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:08.508159 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.508120    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.510049 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.510016    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-kube-api-access-24zw5" pod "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c"). InnerVolumeSpecName "kube-api-access-24zw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:08.510604 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.510563    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle" pod "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c"). InnerVolumeSpecName "data-science-usage-logs-lokistack-gateway-ca-bundle". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:08.510726 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.510640    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-client-http" pod "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c"). InnerVolumeSpecName "data-science-usage-logs-lokistack-gateway-client-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:08.510798 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.510722    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret" pod "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c"). InnerVolumeSpecName "tls-secret". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:08.513103 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:08.513079    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac podName:e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c nodeName:}" failed. No retries permitted until 2026-10-30 21:37:09.013060121 +0000 UTC m=+3603.969074897 (durationBeforeRetry 500ms). Error: error cleaning subPath mounts for volume "kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac" (UniqueName: "kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac") pod "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c") : error deleting /var/lib/kubelet/pods/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c/volume-subpaths: remove /var/lib/kubelet/pods/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c/volume-subpaths: no such file or directory
Oct 30 21:37:08.513219 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.513169    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-lokistack-gateway" pod "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c"). InnerVolumeSpecName "lokistack-gateway". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:08.514714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.514694    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tenants" pod "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c"). InnerVolumeSpecName "tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:37:08.608554 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.608514    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.608554 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.608556    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24zw5\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-kube-api-access-24zw5\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.608710 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.608567    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-data-science-usage-logs-lokistack-gateway-client-http\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.608710 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.608577    5937 reconciler_common.go:299] "Volume detached for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-lokistack-gateway\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.608710 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.608586    5937 reconciler_common.go:299] "Volume detached for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tls-secret\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.608710 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.608595    5937 reconciler_common.go:299] "Volume detached for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-tenants\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:08.732948 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.732916    5937 generic.go:356] "Generic (PLEG): container finished" podID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerID="af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe" exitCode=0
Oct 30 21:37:08.733089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.732989    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"
Oct 30 21:37:08.733089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.733004    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" event={"ID":"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c","Type":"ContainerDied","Data":"af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe"}
Oct 30 21:37:08.733089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.733057    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk" event={"ID":"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c","Type":"ContainerDied","Data":"02591e62ed85639353051e7adee417150561f3f076cce8dbfe553887650c8af6"}
Oct 30 21:37:08.733089 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.733082    5937 scope.go:122] "RemoveContainer" containerID="4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1"
Oct 30 21:37:08.734505 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.734484    5937 generic.go:356] "Generic (PLEG): container finished" podID="219f0034-c3e2-45a8-8ce6-420ad6711335" containerID="99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216" exitCode=0
Oct 30 21:37:08.734638 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.734562    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb" event={"ID":"219f0034-c3e2-45a8-8ce6-420ad6711335","Type":"ContainerDied","Data":"99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216"}
Oct 30 21:37:08.734638 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.734583    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb" event={"ID":"219f0034-c3e2-45a8-8ce6-420ad6711335","Type":"ContainerDied","Data":"b7f96208b1b9b17f5c20f9ecee031fce205132ec760b5d4d3030149466a2c74c"}
Oct 30 21:37:08.734728 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.734706    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"
Oct 30 21:37:08.742682 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.742662    5937 scope.go:122] "RemoveContainer" containerID="af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe"
Oct 30 21:37:08.750871 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.750852    5937 scope.go:122] "RemoveContainer" containerID="4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1"
Oct 30 21:37:08.751146 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:08.751122    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1\": container with ID starting with 4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1 not found: ID does not exist" containerID="4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1"
Oct 30 21:37:08.751189 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.751155    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1"} err="failed to get container status \"4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1\": rpc error: code = NotFound desc = could not find container \"4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1\": container with ID starting with 4762b735a222bbf250a2955f92916eecb4ab177bc7ba4951762f3c4c428b0be1 not found: ID does not exist"
Oct 30 21:37:08.751189 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.751172    5937 scope.go:122] "RemoveContainer" containerID="af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe"
Oct 30 21:37:08.751417 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:08.751401    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe\": container with ID starting with af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe not found: ID does not exist" containerID="af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe"
Oct 30 21:37:08.751453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.751431    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe"} err="failed to get container status \"af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe\": rpc error: code = NotFound desc = could not find container \"af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe\": container with ID starting with af66d52b57c249923b48c6b64159e6400560881a93815ba0274a4ef4dd093dbe not found: ID does not exist"
Oct 30 21:37:08.751453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.751445    5937 scope.go:122] "RemoveContainer" containerID="99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216"
Oct 30 21:37:08.759103 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.759087    5937 scope.go:122] "RemoveContainer" containerID="99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216"
Oct 30 21:37:08.759391 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:08.759374    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216\": container with ID starting with 99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216 not found: ID does not exist" containerID="99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216"
Oct 30 21:37:08.759458 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.759400    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216"} err="failed to get container status \"99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216\": rpc error: code = NotFound desc = could not find container \"99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216\": container with ID starting with 99c93201117b93f724a16b1c79966e923e841f671ba38f03f9e7bd73956c4216 not found: ID does not exist"
Oct 30 21:37:08.899766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.899734    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"]
Oct 30 21:37:08.906853 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:08.906825    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-distributor-6bf78c4576-q2cmb"]
Oct 30 21:37:09.112644 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:09.112573    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac\") pod \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\" (UID: \"e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c\") "
Oct 30 21:37:09.112920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:09.112897    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac" pod "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" (UID: "e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c"). InnerVolumeSpecName "rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:09.161034 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:09.161008    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="219f0034-c3e2-45a8-8ce6-420ad6711335" path="/var/lib/kubelet/pods/219f0034-c3e2-45a8-8ce6-420ad6711335/volumes"
Oct 30 21:37:09.213420 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:09.213395    5937 reconciler_common.go:299] "Volume detached for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c-rbac\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:09.449251 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:09.449182    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"]
Oct 30 21:37:09.499740 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:09.499708    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-55c7794f8d-kjcxk"]
Oct 30 21:37:11.160375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:11.160345    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" path="/var/lib/kubelet/pods/e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c/volumes"
Oct 30 21:37:14.201090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:14.201035    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:37:14.201464 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:14.201153    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:37:15.607388 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607357    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"]
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607707    5937 cpu_manager.go:414] "containerMap: removing container" podUID="aba9e01c-e332-4024-bbfa-349d420cfe0b" containerName="loki-querier"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607718    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aba9e01c-e332-4024-bbfa-349d420cfe0b" containerName="loki-querier"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607734    5937 cpu_manager.go:414] "containerMap: removing container" podUID="edc75104-4c13-48f9-86f2-91f760482048" containerName="loki-compactor"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607739    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edc75104-4c13-48f9-86f2-91f760482048" containerName="loki-compactor"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607749    5937 cpu_manager.go:414] "containerMap: removing container" podUID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerName="opa"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607755    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerName="opa"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607768    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerName="opa"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607772    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerName="opa"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607781    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1" containerName="otc-container"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607785    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1" containerName="otc-container"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607792    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerName="gateway"
Oct 30 21:37:15.607790 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607797    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerName="gateway"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607805    5937 cpu_manager.go:414] "containerMap: removing container" podUID="b2a37c64-507c-400a-a453-02cabf5328eb" containerName="loki-index-gateway"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607810    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2a37c64-507c-400a-a453-02cabf5328eb" containerName="loki-index-gateway"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607821    5937 cpu_manager.go:414] "containerMap: removing container" podUID="219f0034-c3e2-45a8-8ce6-420ad6711335" containerName="loki-distributor"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607826    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="219f0034-c3e2-45a8-8ce6-420ad6711335" containerName="loki-distributor"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607833    5937 cpu_manager.go:414] "containerMap: removing container" podUID="c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" containerName="collector"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607837    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" containerName="collector"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607844    5937 cpu_manager.go:414] "containerMap: removing container" podUID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerName="gateway"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607848    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerName="gateway"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607900    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="219f0034-c3e2-45a8-8ce6-420ad6711335" containerName="loki-distributor"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607906    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="c07b7a39-a1b7-4862-b887-b9e2cd4f0da5" containerName="collector"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607912    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerName="gateway"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607919    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="aba9e01c-e332-4024-bbfa-349d420cfe0b" containerName="loki-querier"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607925    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="edc75104-4c13-48f9-86f2-91f760482048" containerName="loki-compactor"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607930    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="fecd9cfc-d055-4945-bbe5-c6266e9a8a06" containerName="opa"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607936    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerName="opa"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607942    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e60e0726-dd8b-4ff9-b2f1-00d8d0d4e8e1" containerName="otc-container"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607948    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e90d2fbb-f9ea-43bb-84c8-8b4ac11a6b2c" containerName="gateway"
Oct 30 21:37:15.608146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.607953    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2a37c64-507c-400a-a453-02cabf5328eb" containerName="loki-index-gateway"
Oct 30 21:37:15.612613 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.612598    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.670123 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.669143    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-dockercfg-c4bmf\""
Oct 30 21:37:15.672784 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:15.672750    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:37:15.719382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.719361    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-ca-bundle\""
Oct 30 21:37:15.719525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.719394    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-config\""
Oct 30 21:37:15.719525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.719438    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-query-frontend-http\""
Oct 30 21:37:15.719525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.719468    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-query-frontend-grpc\""
Oct 30 21:37:15.720425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.720407    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"]
Oct 30 21:37:15.769273 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.769247    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-config\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.769409 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.769282    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw6c6\" (UniqueName: \"kubernetes.io/projected/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-kube-api-access-lw6c6\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.769409 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.769306    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-http\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.769573 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.769415    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-grpc\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.769573 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.769478    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.870324 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.870259    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-config\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.870324 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.870295    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw6c6\" (UniqueName: \"kubernetes.io/projected/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-kube-api-access-lw6c6\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.870324 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.870317    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-http\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.870610 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.870346    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-grpc\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.870610 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.870368    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.871119 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.871088    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.871301 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.871279    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-config\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.873024 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.873001    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-http\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.873199 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.873172    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-grpc\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:15.933355 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:15.933326    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw6c6\" (UniqueName: \"kubernetes.io/projected/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-kube-api-access-lw6c6\") pod \"data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:16.224250 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.224214    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:16.304218 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.304179    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"]
Oct 30 21:37:16.309366 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.309348    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.363507 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.363481    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway-http\""
Oct 30 21:37:16.367841 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.367805    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"]
Oct 30 21:37:16.369616 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.369596    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway-ca-bundle\""
Oct 30 21:37:16.369707 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.369681    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway\""
Oct 30 21:37:16.374112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.374089    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.374211 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.374129    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.374211 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.374152    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-lokistack-gateway\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.374341 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.374320    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-tenants\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.374418 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.374400    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.374484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.374463    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-client-http\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.374569 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.374517    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-rbac\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.374639 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.374624    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvlpd\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-kube-api-access-qvlpd\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.463801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.463772    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway\""
Oct 30 21:37:16.463895 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.463802    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-usage-logs-lokistack-gateway-client-http\""
Oct 30 21:37:16.475574 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.475489    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.475574 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.475523    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-client-http\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.475741 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.475588    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-rbac\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.475741 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.475625    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvlpd\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-kube-api-access-qvlpd\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.475741 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:16.475639    5937 projected.go:304] Couldn't get configMap payload redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-ca-bundle: configmap references non-existent config key: service-ca.crt
Oct 30 21:37:16.475741 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:16.475657    5937 projected.go:196] Error preparing data for projected volume data-science-usage-logs-lokistack-gateway-ca-bundle for pod redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn: configmap references non-existent config key: service-ca.crt
Oct 30 21:37:16.475741 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:16.475704    5937 projected.go:266] Couldn't get secret redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-http: secret "data-science-usage-logs-lokistack-gateway-http" not found
Oct 30 21:37:16.475741 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:16.475718    5937 projected.go:266] Couldn't get secret redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-http: secret "data-science-usage-logs-lokistack-gateway-http" not found
Oct 30 21:37:16.475741 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:16.475720    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle podName:39b0d528-3c2a-4cda-929a-1102c46bb766 nodeName:}" failed. No retries permitted until 2026-10-30 21:37:16.975699584 +0000 UTC m=+3611.931714350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "data-science-usage-logs-lokistack-gateway-ca-bundle" (UniqueName: "kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle") pod "data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766") : configmap references non-existent config key: service-ca.crt
Oct 30 21:37:16.475741 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:16.475726    5937 projected.go:196] Error preparing data for projected volume tls-secret for pod redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn: secret "data-science-usage-logs-lokistack-gateway-http" not found
Oct 30 21:37:16.475741 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.475642    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.476149 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.475794    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.476149 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.475831    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-lokistack-gateway\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.476149 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:16.475853    5937 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret podName:39b0d528-3c2a-4cda-929a-1102c46bb766 nodeName:}" failed. No retries permitted until 2026-10-30 21:37:16.975834307 +0000 UTC m=+3611.931849076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-secret" (UniqueName: "kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret") pod "data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766") : secret "data-science-usage-logs-lokistack-gateway-http" not found
Oct 30 21:37:16.476149 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.475905    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-tenants\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.476470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.476452    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-lokistack-gateway\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.476731 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.476711    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-rbac\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.476775 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.476710    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.478353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.478332    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-tenants\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.478463 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.478393    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-client-http\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.538734 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.538711    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvlpd\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-kube-api-access-qvlpd\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.599766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.599737    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"]
Oct 30 21:37:16.601973 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:37:16.601948    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd18ceb02_8f6f_42d5_8fc9_ba51d1a148bb.slice/crio-7b875b166ad65e836d1ef616f392c654ac1db02dc3f49e74da55754aa4807df4 WatchSource:0}: Error finding container 7b875b166ad65e836d1ef616f392c654ac1db02dc3f49e74da55754aa4807df4: Status 404 returned error can't find the container with id 7b875b166ad65e836d1ef616f392c654ac1db02dc3f49e74da55754aa4807df4
Oct 30 21:37:16.773698 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.773618    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj" event={"ID":"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb","Type":"ContainerStarted","Data":"6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981"}
Oct 30 21:37:16.773698 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.773657    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj" event={"ID":"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb","Type":"ContainerStarted","Data":"7b875b166ad65e836d1ef616f392c654ac1db02dc3f49e74da55754aa4807df4"}
Oct 30 21:37:16.774289 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.773750    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:16.893525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.893474    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj" podStartSLOduration=1.893459609 podStartE2EDuration="1.893459609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:16.892823498 +0000 UTC m=+3611.848838273" watchObservedRunningTime="2026-10-30 21:37:16.893459609 +0000 UTC m=+3611.849474379"
Oct 30 21:37:16.981497 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.981463    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.981690 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.981573    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.983995 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.983972    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:16.984191 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:16.984170    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret\") pod \"data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") " pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:17.223411 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:17.223383    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:17.699343 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:37:17.699314    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39b0d528_3c2a_4cda_929a_1102c46bb766.slice/crio-d5a7440c8d7efcfd5ee82c09e6f8cffc6a0c098a7e1a05c6503eb142fd9ae014 WatchSource:0}: Error finding container d5a7440c8d7efcfd5ee82c09e6f8cffc6a0c098a7e1a05c6503eb142fd9ae014: Status 404 returned error can't find the container with id d5a7440c8d7efcfd5ee82c09e6f8cffc6a0c098a7e1a05c6503eb142fd9ae014
Oct 30 21:37:17.747690 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:17.747663    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"]
Oct 30 21:37:17.780582 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:17.780559    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" event={"ID":"39b0d528-3c2a-4cda-929a-1102c46bb766","Type":"ContainerStarted","Data":"d5a7440c8d7efcfd5ee82c09e6f8cffc6a0c098a7e1a05c6503eb142fd9ae014"}
Oct 30 21:37:18.787333 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:18.787300    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" event={"ID":"39b0d528-3c2a-4cda-929a-1102c46bb766","Type":"ContainerStarted","Data":"5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2"}
Oct 30 21:37:18.787333 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:18.787338    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" event={"ID":"39b0d528-3c2a-4cda-929a-1102c46bb766","Type":"ContainerStarted","Data":"621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b"}
Oct 30 21:37:18.787884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:18.787483    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:18.787884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:18.787518    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:18.795159 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:18.795138    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:18.798422 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:18.798404    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:37:18.960563 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:18.960498    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" podStartSLOduration=2.960485904 podStartE2EDuration="2.960485904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:18.959985411 +0000 UTC m=+3613.916000188" watchObservedRunningTime="2026-10-30 21:37:18.960485904 +0000 UTC m=+3613.916500679"
Oct 30 21:37:24.201276 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:24.201238    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:37:34.201093 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:34.201057    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:37:37.786930 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:37.786904    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:37:44.200803 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:44.200767    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:37:45.671002 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:37:45.670965    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:37:54.201179 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:37:54.201140    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:38:04.201461 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:04.201420    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:38:14.201009 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:14.200974    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:38:15.672679 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:38:15.672642    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:38:24.200968 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:24.200935    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:38:34.201205 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:34.201170    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:38:37.768356 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:37.768322    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"]
Oct 30 21:38:37.768833 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:37.768678    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj" podUID="d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" containerName="loki-query-frontend" containerID="cri-o://6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981" gracePeriod=30
Oct 30 21:38:37.776057 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:37.775932    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"]
Oct 30 21:38:37.776154 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:37.776116    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="opa" containerID="cri-o://621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b" gracePeriod=30
Oct 30 21:38:37.776243 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:37.776210    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="gateway" containerID="cri-o://5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2" gracePeriod=30
Oct 30 21:38:37.780976 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:37.780947    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj" podUID="d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" containerName="loki-query-frontend" probeResult="failure" output="Get \"https://10.134.0.147:3101/loki/api/v1/status/buildinfo\": dial tcp 10.134.0.147:3101: connect: connection refused"
Oct 30 21:38:38.024331 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.024282    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:38:38.072280 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.072256    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-kube-api-access-lw6c6\" (UniqueName: \"kubernetes.io/projected/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-kube-api-access-lw6c6\") pod \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") "
Oct 30 21:38:38.072409 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.072296    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-grpc\") pod \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") "
Oct 30 21:38:38.072450 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.072416    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-http\") pod \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") "
Oct 30 21:38:38.072482 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.072465    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-config\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-config\") pod \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") "
Oct 30 21:38:38.072532 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.072516    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-ca-bundle\") pod \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\" (UID: \"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb\") "
Oct 30 21:38:38.072928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.072898    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-config" pod "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" (UID: "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:38.072928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.072917    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-ca-bundle" pod "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" (UID: "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:38.074649 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.074627    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-http" pod "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" (UID: "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb"). InnerVolumeSpecName "data-science-usage-logs-lokistack-query-frontend-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:38.074988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.074961    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-grpc" pod "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" (UID: "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb"). InnerVolumeSpecName "data-science-usage-logs-lokistack-query-frontend-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:38.075079 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.074986    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-kube-api-access-lw6c6" pod "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" (UID: "d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb"). InnerVolumeSpecName "kube-api-access-lw6c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:38.129311 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.129273    5937 generic.go:356] "Generic (PLEG): container finished" podID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerID="621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b" exitCode=0
Oct 30 21:38:38.129475 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.129310    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" event={"ID":"39b0d528-3c2a-4cda-929a-1102c46bb766","Type":"ContainerDied","Data":"621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b"}
Oct 30 21:38:38.130712 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.130687    5937 generic.go:356] "Generic (PLEG): container finished" podID="d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" containerID="6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981" exitCode=0
Oct 30 21:38:38.130828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.130723    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj" event={"ID":"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb","Type":"ContainerDied","Data":"6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981"}
Oct 30 21:38:38.130828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.130747    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"
Oct 30 21:38:38.130828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.130760    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj" event={"ID":"d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb","Type":"ContainerDied","Data":"7b875b166ad65e836d1ef616f392c654ac1db02dc3f49e74da55754aa4807df4"}
Oct 30 21:38:38.130828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.130777    5937 scope.go:122] "RemoveContainer" containerID="6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981"
Oct 30 21:38:38.139409 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.139390    5937 scope.go:122] "RemoveContainer" containerID="6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981"
Oct 30 21:38:38.139711 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:38:38.139689    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981\": container with ID starting with 6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981 not found: ID does not exist" containerID="6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981"
Oct 30 21:38:38.139766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.139720    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981"} err="failed to get container status \"6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981\": rpc error: code = NotFound desc = could not find container \"6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981\": container with ID starting with 6bd0a6c71d1f1ef3c83c3dad1ee1c6c1496f88d408e5693be03f1f93edc97981 not found: ID does not exist"
Oct 30 21:38:38.174190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.174170    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw6c6\" (UniqueName: \"kubernetes.io/projected/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-kube-api-access-lw6c6\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.174295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.174192    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-query-frontend-grpc\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-grpc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.174295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.174202    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-query-frontend-http\" (UniqueName: \"kubernetes.io/secret/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-query-frontend-http\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.174295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.174229    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.174295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.174245    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:38.287619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.287520    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"]
Oct 30 21:38:38.292408 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.292384    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-query-frontend-7d747cfbbfb5xj"]
Oct 30 21:38:38.788221 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.788182    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="opa" probeResult="failure" output="Get \"https://10.134.0.148:8083/ready\": dial tcp 10.134.0.148:8083: connect: connection refused"
Oct 30 21:38:38.792214 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:38.792180    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="gateway" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:38:39.028819 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.028793    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:38:39.082515 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.082435    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-rbac\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-rbac\") pod \"39b0d528-3c2a-4cda-929a-1102c46bb766\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") "
Oct 30 21:38:39.082515 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.082478    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-tenants\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-tenants\") pod \"39b0d528-3c2a-4cda-929a-1102c46bb766\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") "
Oct 30 21:38:39.082515 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.082510    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle\") pod \"39b0d528-3c2a-4cda-929a-1102c46bb766\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") "
Oct 30 21:38:39.082827 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.082595    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-lokistack-gateway\") pod \"39b0d528-3c2a-4cda-929a-1102c46bb766\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") "
Oct 30 21:38:39.082827 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.082646    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret\") pod \"39b0d528-3c2a-4cda-929a-1102c46bb766\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") "
Oct 30 21:38:39.082827 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.082688    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-client-http\") pod \"39b0d528-3c2a-4cda-929a-1102c46bb766\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") "
Oct 30 21:38:39.082827 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.082724    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-kube-api-access-qvlpd\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-kube-api-access-qvlpd\") pod \"39b0d528-3c2a-4cda-929a-1102c46bb766\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") "
Oct 30 21:38:39.082827 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.082757    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-ca-bundle\") pod \"39b0d528-3c2a-4cda-929a-1102c46bb766\" (UID: \"39b0d528-3c2a-4cda-929a-1102c46bb766\") "
Oct 30 21:38:39.083364 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.083337    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-ca-bundle" pod "39b0d528-3c2a-4cda-929a-1102c46bb766" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766"). InnerVolumeSpecName "data-science-usage-logs-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:39.085448 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.085417    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle" pod "39b0d528-3c2a-4cda-929a-1102c46bb766" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766"). InnerVolumeSpecName "data-science-usage-logs-lokistack-gateway-ca-bundle". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:39.085847 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.085816    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-client-http" pod "39b0d528-3c2a-4cda-929a-1102c46bb766" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766"). InnerVolumeSpecName "data-science-usage-logs-lokistack-gateway-client-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:39.086070 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.086051    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret" pod "39b0d528-3c2a-4cda-929a-1102c46bb766" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766"). InnerVolumeSpecName "tls-secret". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:39.086148 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.086065    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-kube-api-access-qvlpd" pod "39b0d528-3c2a-4cda-929a-1102c46bb766" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766"). InnerVolumeSpecName "kube-api-access-qvlpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:38:39.088363 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.088344    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-rbac" pod "39b0d528-3c2a-4cda-929a-1102c46bb766" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766"). InnerVolumeSpecName "rbac". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:39.088441 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.088422    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-lokistack-gateway" pod "39b0d528-3c2a-4cda-929a-1102c46bb766" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766"). InnerVolumeSpecName "lokistack-gateway". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:38:39.090434 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.090416    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-tenants" pod "39b0d528-3c2a-4cda-929a-1102c46bb766" (UID: "39b0d528-3c2a-4cda-929a-1102c46bb766"). InnerVolumeSpecName "tenants". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:38:39.137255 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.137223    5937 generic.go:356] "Generic (PLEG): container finished" podID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerID="5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2" exitCode=0
Oct 30 21:38:39.137453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.137273    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"
Oct 30 21:38:39.137453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.137308    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" event={"ID":"39b0d528-3c2a-4cda-929a-1102c46bb766","Type":"ContainerDied","Data":"5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2"}
Oct 30 21:38:39.137453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.137355    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn" event={"ID":"39b0d528-3c2a-4cda-929a-1102c46bb766","Type":"ContainerDied","Data":"d5a7440c8d7efcfd5ee82c09e6f8cffc6a0c098a7e1a05c6503eb142fd9ae014"}
Oct 30 21:38:39.137453 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.137377    5937 scope.go:122] "RemoveContainer" containerID="621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b"
Oct 30 21:38:39.146688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.146671    5937 scope.go:122] "RemoveContainer" containerID="5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2"
Oct 30 21:38:39.156726 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.156439    5937 scope.go:122] "RemoveContainer" containerID="621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b"
Oct 30 21:38:39.157267 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:38:39.157236    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b\": container with ID starting with 621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b not found: ID does not exist" containerID="621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b"
Oct 30 21:38:39.157391 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.157279    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b"} err="failed to get container status \"621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b\": rpc error: code = NotFound desc = could not find container \"621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b\": container with ID starting with 621120b204d053ee68d62d68034ed468466110ab9ade0101d201c6593f055a1b not found: ID does not exist"
Oct 30 21:38:39.157391 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.157303    5937 scope.go:122] "RemoveContainer" containerID="5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2"
Oct 30 21:38:39.157861 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:38:39.157836    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2\": container with ID starting with 5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2 not found: ID does not exist" containerID="5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2"
Oct 30 21:38:39.157952 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.157872    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2"} err="failed to get container status \"5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2\": rpc error: code = NotFound desc = could not find container \"5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2\": container with ID starting with 5dd0680b9937806a3c8c7d51078b3eb59170d2a3b9697c86526d2b25c263e1a2 not found: ID does not exist"
Oct 30 21:38:39.162354 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.162327    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" path="/var/lib/kubelet/pods/d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb/volumes"
Oct 30 21:38:39.183928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.183902    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-gateway-ca-bundle\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.183928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.183927    5937 reconciler_common.go:299] "Volume detached for volume \"lokistack-gateway\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-lokistack-gateway\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.184107 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.183938    5937 reconciler_common.go:299] "Volume detached for volume \"tls-secret\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-tls-secret\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.184107 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.183948    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-gateway-client-http\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-gateway-client-http\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.184107 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.183960    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvlpd\" (UniqueName: \"kubernetes.io/projected/39b0d528-3c2a-4cda-929a-1102c46bb766-kube-api-access-qvlpd\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.184107 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.183971    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-usage-logs-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-data-science-usage-logs-lokistack-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.184107 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.183980    5937 reconciler_common.go:299] "Volume detached for volume \"rbac\" (UniqueName: \"kubernetes.io/configmap/39b0d528-3c2a-4cda-929a-1102c46bb766-rbac\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.184107 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.183988    5937 reconciler_common.go:299] "Volume detached for volume \"tenants\" (UniqueName: \"kubernetes.io/secret/39b0d528-3c2a-4cda-929a-1102c46bb766-tenants\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:38:39.266421 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.266388    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"]
Oct 30 21:38:39.271063 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:39.271039    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-usage-logs-lokistack-gateway-6ccc687d59-8wtmn"]
Oct 30 21:38:40.237480 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:40.237449    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:38:40.241884 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:40.241864    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs-bucket-creator"]
Oct 30 21:38:40.287863 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:40.287839    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:38:40.288022 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:40.287996    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/seaweedfs" podUID="bb99a257-6331-4108-a724-662fcd693d27" containerName="seaweedfs" containerID="cri-o://cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b" gracePeriod=30
Oct 30 21:38:41.160893 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:41.160857    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" path="/var/lib/kubelet/pods/39b0d528-3c2a-4cda-929a-1102c46bb766/volumes"
Oct 30 21:38:41.161229 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:41.161216    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c1dd05f-8218-4879-8b1a-5a436fda6979" path="/var/lib/kubelet/pods/3c1dd05f-8218-4879-8b1a-5a436fda6979/volumes"
Oct 30 21:38:44.201176 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:44.201139    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:38:45.671529 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:38:45.671481    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:38:54.201627 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:38:54.201586    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:39:04.200912 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:04.200871    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:39:05.537139 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:05.537115    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:39:05.721305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:05.721264    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb99a257-6331-4108-a724-662fcd693d27-kube-api-access-n6c4n\" (UniqueName: \"kubernetes.io/projected/bb99a257-6331-4108-a724-662fcd693d27-kube-api-access-n6c4n\") pod \"bb99a257-6331-4108-a724-662fcd693d27\" (UID: \"bb99a257-6331-4108-a724-662fcd693d27\") "
Oct 30 21:39:05.721498 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:05.721397    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb99a257-6331-4108-a724-662fcd693d27-data\" (UniqueName: \"kubernetes.io/empty-dir/bb99a257-6331-4108-a724-662fcd693d27-data\") pod \"bb99a257-6331-4108-a724-662fcd693d27\" (UID: \"bb99a257-6331-4108-a724-662fcd693d27\") "
Oct 30 21:39:05.722495 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:05.722471    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb99a257-6331-4108-a724-662fcd693d27-data" pod "bb99a257-6331-4108-a724-662fcd693d27" (UID: "bb99a257-6331-4108-a724-662fcd693d27"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:39:05.723495 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:05.723467    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb99a257-6331-4108-a724-662fcd693d27-kube-api-access-n6c4n" pod "bb99a257-6331-4108-a724-662fcd693d27" (UID: "bb99a257-6331-4108-a724-662fcd693d27"). InnerVolumeSpecName "kube-api-access-n6c4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:39:05.822824 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:05.822791    5937 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb99a257-6331-4108-a724-662fcd693d27-data\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:39:05.822824 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:05.822820    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6c4n\" (UniqueName: \"kubernetes.io/projected/bb99a257-6331-4108-a724-662fcd693d27-kube-api-access-n6c4n\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:39:06.257890 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.257853    5937 generic.go:356] "Generic (PLEG): container finished" podID="bb99a257-6331-4108-a724-662fcd693d27" containerID="cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b" exitCode=0
Oct 30 21:39:06.258105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.257898    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/seaweedfs"
Oct 30 21:39:06.258105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.257917    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"bb99a257-6331-4108-a724-662fcd693d27","Type":"ContainerDied","Data":"cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b"}
Oct 30 21:39:06.258105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.257945    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/seaweedfs" event={"ID":"bb99a257-6331-4108-a724-662fcd693d27","Type":"ContainerDied","Data":"3ab3ded62f92e3cdb23ecbf5e22cc72bb61067082a77f37b06d00e075a959d16"}
Oct 30 21:39:06.258105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.257962    5937 scope.go:122] "RemoveContainer" containerID="cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b"
Oct 30 21:39:06.268228 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.268185    5937 scope.go:122] "RemoveContainer" containerID="cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b"
Oct 30 21:39:06.268473 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:39:06.268452    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b\": container with ID starting with cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b not found: ID does not exist" containerID="cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b"
Oct 30 21:39:06.268556 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.268490    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b"} err="failed to get container status \"cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b\": rpc error: code = NotFound desc = could not find container \"cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b\": container with ID starting with cf23f293cafd91eb7ef61254323be7b46f80e98c596982585fb0d67f2a05476b not found: ID does not exist"
Oct 30 21:39:06.357705 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.357678    5937 scope.go:122] "RemoveContainer" containerID="6c87b598377a02394b71b0f0b172e7ef19e1a3eb6574d8170ffb4efa714648ca"
Oct 30 21:39:06.424014 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.423988    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:39:06.428216 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:06.428194    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/seaweedfs"]
Oct 30 21:39:07.161309 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:07.161276    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb99a257-6331-4108-a724-662fcd693d27" path="/var/lib/kubelet/pods/bb99a257-6331-4108-a724-662fcd693d27/volumes"
Oct 30 21:39:14.200688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:14.200656    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:39:15.671828 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:39:15.671764    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:39:19.021357 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021322    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"]
Oct 30 21:39:19.021748 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021690    5937 cpu_manager.go:414] "containerMap: removing container" podUID="bb99a257-6331-4108-a724-662fcd693d27" containerName="seaweedfs"
Oct 30 21:39:19.021748 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021702    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb99a257-6331-4108-a724-662fcd693d27" containerName="seaweedfs"
Oct 30 21:39:19.021748 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021723    5937 cpu_manager.go:414] "containerMap: removing container" podUID="d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" containerName="loki-query-frontend"
Oct 30 21:39:19.021748 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021728    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" containerName="loki-query-frontend"
Oct 30 21:39:19.021748 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021745    5937 cpu_manager.go:414] "containerMap: removing container" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="opa"
Oct 30 21:39:19.021748 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021750    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="opa"
Oct 30 21:39:19.021938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021763    5937 cpu_manager.go:414] "containerMap: removing container" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="gateway"
Oct 30 21:39:19.021938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021768    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="gateway"
Oct 30 21:39:19.021938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021824    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="d18ceb02-8f6f-42d5-8fc9-ba51d1a148bb" containerName="loki-query-frontend"
Oct 30 21:39:19.021938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021832    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="opa"
Oct 30 21:39:19.021938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021840    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="39b0d528-3c2a-4cda-929a-1102c46bb766" containerName="gateway"
Oct 30 21:39:19.021938 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.021846    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb99a257-6331-4108-a724-662fcd693d27" containerName="seaweedfs"
Oct 30 21:39:19.025678 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.025655    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"
Oct 30 21:39:19.081236 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.081206    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"]
Oct 30 21:39:19.127488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.127450    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6smlj\" (UniqueName: \"kubernetes.io/projected/48ae041d-366f-45cf-b667-a716570db0c3-kube-api-access-6smlj\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m\" (UID: \"48ae041d-366f-45cf-b667-a716570db0c3\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"
Oct 30 21:39:19.130666 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.130650    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:39:19.228466 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.228436    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6smlj\" (UniqueName: \"kubernetes.io/projected/48ae041d-366f-45cf-b667-a716570db0c3-kube-api-access-6smlj\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m\" (UID: \"48ae041d-366f-45cf-b667-a716570db0c3\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"
Oct 30 21:39:19.291190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.291133    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6smlj\" (UniqueName: \"kubernetes.io/projected/48ae041d-366f-45cf-b667-a716570db0c3-kube-api-access-6smlj\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m\" (UID: \"48ae041d-366f-45cf-b667-a716570db0c3\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"
Oct 30 21:39:19.336545 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.336518    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"
Oct 30 21:39:19.703054 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:19.703033    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"]
Oct 30 21:39:19.705585 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:39:19.705554    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48ae041d_366f_45cf_b667_a716570db0c3.slice/crio-5cef1b2b8e6bad940171eca70c12d01c637e8c1d5f3c1b81ae6b62821d43460f WatchSource:0}: Error finding container 5cef1b2b8e6bad940171eca70c12d01c637e8c1d5f3c1b81ae6b62821d43460f: Status 404 returned error can't find the container with id 5cef1b2b8e6bad940171eca70c12d01c637e8c1d5f3c1b81ae6b62821d43460f
Oct 30 21:39:20.317718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:20.317684    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m" event={"ID":"48ae041d-366f-45cf-b667-a716570db0c3","Type":"ContainerStarted","Data":"3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c"}
Oct 30 21:39:20.317718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:20.317722    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m" event={"ID":"48ae041d-366f-45cf-b667-a716570db0c3","Type":"ContainerStarted","Data":"5cef1b2b8e6bad940171eca70c12d01c637e8c1d5f3c1b81ae6b62821d43460f"}
Oct 30 21:39:20.435653 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:20.435609    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m" podStartSLOduration=2.435594813 podStartE2EDuration="2.435594813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:20.434904498 +0000 UTC m=+3735.390919275" watchObservedRunningTime="2026-10-30 21:39:20.435594813 +0000 UTC m=+3735.391609584"
Oct 30 21:39:22.302978 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.302945    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:39:22.306238 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.306219    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.364355 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.364326    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:39:22.410754 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.410733    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:39:22.495586 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.495560    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"]
Oct 30 21:39:22.498785 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.498767    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:22.552290 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.552262    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-bsxkp\""
Oct 30 21:39:22.552419 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.552354    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:39:22.552419 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.552377    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:39:22.554905 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.554858    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9c9719d-e029-4e49-93be-144bcc71ee3f-config\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.555017 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.555001    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e9c9719d-e029-4e49-93be-144bcc71ee3f-plugins\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.555122 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.555060    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rhtv\" (UniqueName: \"kubernetes.io/projected/e9c9719d-e029-4e49-93be-144bcc71ee3f-kube-api-access-4rhtv\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.556830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.556810    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"]
Oct 30 21:39:22.656515 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.656492    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e9c9719d-e029-4e49-93be-144bcc71ee3f-plugins\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.656647 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.656558    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6497495954-dh5qs\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:22.656647 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.656583    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rhtv\" (UniqueName: \"kubernetes.io/projected/e9c9719d-e029-4e49-93be-144bcc71ee3f-kube-api-access-4rhtv\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.656647 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.656604    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-ta-internal\") pod \"data-science-collector-targetallocator-6497495954-dh5qs\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:22.656647 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.656623    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9c9719d-e029-4e49-93be-144bcc71ee3f-config\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.656853 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.656780    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55sb\" (UniqueName: \"kubernetes.io/projected/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-kube-api-access-t55sb\") pod \"data-science-collector-targetallocator-6497495954-dh5qs\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:22.656853 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.656835    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e9c9719d-e029-4e49-93be-144bcc71ee3f-plugins\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.657197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.657181    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9c9719d-e029-4e49-93be-144bcc71ee3f-config\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.718890 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.718860    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rhtv\" (UniqueName: \"kubernetes.io/projected/e9c9719d-e029-4e49-93be-144bcc71ee3f-kube-api-access-4rhtv\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:22.757562 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.757524    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t55sb\" (UniqueName: \"kubernetes.io/projected/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-kube-api-access-t55sb\") pod \"data-science-collector-targetallocator-6497495954-dh5qs\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:22.757685 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.757614    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6497495954-dh5qs\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:22.757685 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.757657    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-ta-internal\") pod \"data-science-collector-targetallocator-6497495954-dh5qs\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:22.758237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.758217    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-ta-internal\") pod \"data-science-collector-targetallocator-6497495954-dh5qs\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:22.759983 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.759965    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6497495954-dh5qs\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:22.824216 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:22.824163    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55sb\" (UniqueName: \"kubernetes.io/projected/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-kube-api-access-t55sb\") pod \"data-science-collector-targetallocator-6497495954-dh5qs\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:23.109795 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:23.109712    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:23.482192 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:23.482022    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"]
Oct 30 21:39:23.485052 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:39:23.485018    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e6b5fe3_8ced_442a_97fa_c0f0ad302777.slice/crio-44c514e9cacc80d22e10b8fadc02782e23474618aca2f6666e10f8744d13fb2d WatchSource:0}: Error finding container 44c514e9cacc80d22e10b8fadc02782e23474618aca2f6666e10f8744d13fb2d: Status 404 returned error can't find the container with id 44c514e9cacc80d22e10b8fadc02782e23474618aca2f6666e10f8744d13fb2d
Oct 30 21:39:23.487138 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:23.487108    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:39:23.487201 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:23.487163    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:39:24.201383 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:24.201297    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:39:24.336405 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:24.336369    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs" event={"ID":"2e6b5fe3-8ced-442a-97fa-c0f0ad302777","Type":"ContainerStarted","Data":"1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58"}
Oct 30 21:39:24.336594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:24.336416    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs" event={"ID":"2e6b5fe3-8ced-442a-97fa-c0f0ad302777","Type":"ContainerStarted","Data":"44c514e9cacc80d22e10b8fadc02782e23474618aca2f6666e10f8744d13fb2d"}
Oct 30 21:39:24.336594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:24.336439    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:24.337516 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:24.337490    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs" podUID="2e6b5fe3-8ced-442a-97fa-c0f0ad302777" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.151:8080/readyz\": dial tcp 10.134.0.151:8080: connect: connection refused"
Oct 30 21:39:24.456646 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:24.456604    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs" podStartSLOduration=2.456590422 podStartE2EDuration="2.456590422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:24.456001199 +0000 UTC m=+3739.412015975" watchObservedRunningTime="2026-10-30 21:39:24.456590422 +0000 UTC m=+3739.412605197"
Oct 30 21:39:25.341742 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:25.341713    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:39:27.397712 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:27.397629    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:27.504700 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:27.504672    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:27.599575 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:27.599527    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:27.599744 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:27.599672    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:27.652953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:27.652897    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:27.793600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:27.793575    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:27.862239 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:27.862214    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:28.017341 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:28.017315    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:28.390024 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:28.390004    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:39:28.392329 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:39:28.392297    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9c9719d_e029_4e49_93be_144bcc71ee3f.slice/crio-0f98813faaa271a53496c526504459fdc6293cf187a4bd8fd3c1e59b1c198623 WatchSource:0}: Error finding container 0f98813faaa271a53496c526504459fdc6293cf187a4bd8fd3c1e59b1c198623: Status 404 returned error can't find the container with id 0f98813faaa271a53496c526504459fdc6293cf187a4bd8fd3c1e59b1c198623
Oct 30 21:39:29.359494 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:29.359451    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e9c9719d-e029-4e49-93be-144bcc71ee3f","Type":"ContainerStarted","Data":"3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf"}
Oct 30 21:39:29.359886 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:29.359506    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e9c9719d-e029-4e49-93be-144bcc71ee3f","Type":"ContainerStarted","Data":"0f98813faaa271a53496c526504459fdc6293cf187a4bd8fd3c1e59b1c198623"}
Oct 30 21:39:29.359886 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:29.359589    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:29.479402 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:29.479340    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=7.479325691 podStartE2EDuration="7.479325691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:29.478558497 +0000 UTC m=+3744.434573268" watchObservedRunningTime="2026-10-30 21:39:29.479325691 +0000 UTC m=+3744.435340458"
Oct 30 21:39:34.201122 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:34.201086    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:39:35.433036 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:35.433003    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"]
Oct 30 21:39:35.433440 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:35.433178    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m" podUID="48ae041d-366f-45cf-b667-a716570db0c3" containerName="thanos-querier" containerID="cri-o://3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c" gracePeriod=30
Oct 30 21:39:35.687149 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:35.687097    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"
Oct 30 21:39:35.768881 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:35.768853    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48ae041d-366f-45cf-b667-a716570db0c3-kube-api-access-6smlj\" (UniqueName: \"kubernetes.io/projected/48ae041d-366f-45cf-b667-a716570db0c3-kube-api-access-6smlj\") pod \"48ae041d-366f-45cf-b667-a716570db0c3\" (UID: \"48ae041d-366f-45cf-b667-a716570db0c3\") "
Oct 30 21:39:35.770944 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:35.770917    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ae041d-366f-45cf-b667-a716570db0c3-kube-api-access-6smlj" pod "48ae041d-366f-45cf-b667-a716570db0c3" (UID: "48ae041d-366f-45cf-b667-a716570db0c3"). InnerVolumeSpecName "kube-api-access-6smlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:39:35.869715 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:35.869678    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6smlj\" (UniqueName: \"kubernetes.io/projected/48ae041d-366f-45cf-b667-a716570db0c3-kube-api-access-6smlj\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:39:36.388443 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:36.388407    5937 generic.go:356] "Generic (PLEG): container finished" podID="48ae041d-366f-45cf-b667-a716570db0c3" containerID="3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c" exitCode=0
Oct 30 21:39:36.388619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:36.388454    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"
Oct 30 21:39:36.388619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:36.388447    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m" event={"ID":"48ae041d-366f-45cf-b667-a716570db0c3","Type":"ContainerDied","Data":"3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c"}
Oct 30 21:39:36.388619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:36.388584    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m" event={"ID":"48ae041d-366f-45cf-b667-a716570db0c3","Type":"ContainerDied","Data":"5cef1b2b8e6bad940171eca70c12d01c637e8c1d5f3c1b81ae6b62821d43460f"}
Oct 30 21:39:36.388619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:36.388603    5937 scope.go:122] "RemoveContainer" containerID="3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c"
Oct 30 21:39:36.397328 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:36.397314    5937 scope.go:122] "RemoveContainer" containerID="3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c"
Oct 30 21:39:36.397603 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:39:36.397586    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c\": container with ID starting with 3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c not found: ID does not exist" containerID="3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c"
Oct 30 21:39:36.397679 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:36.397611    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c"} err="failed to get container status \"3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c\": rpc error: code = NotFound desc = could not find container \"3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c\": container with ID starting with 3ebd98b07e42a765ea7ddd1f4baa1c3def68942d8304500cbe4eac88d0471a3c not found: ID does not exist"
Oct 30 21:39:36.554762 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:36.554740    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"]
Oct 30 21:39:36.561664 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:36.561643    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-fz68m"]
Oct 30 21:39:37.160518 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:37.160474    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="48ae041d-366f-45cf-b667-a716570db0c3" path="/var/lib/kubelet/pods/48ae041d-366f-45cf-b667-a716570db0c3/volumes"
Oct 30 21:39:40.365667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:40.365638    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:39:44.201488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:44.201456    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:39:45.671388 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:39:45.671356    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:39:54.201446 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:39:54.201408    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:40:04.201434 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:04.201393    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:40:14.201499 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:14.201447    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:40:15.671236 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:40:15.671199    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:40:20.301364 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.301330    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"]
Oct 30 21:40:20.301770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.301676    5937 cpu_manager.go:414] "containerMap: removing container" podUID="48ae041d-366f-45cf-b667-a716570db0c3" containerName="thanos-querier"
Oct 30 21:40:20.301770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.301687    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48ae041d-366f-45cf-b667-a716570db0c3" containerName="thanos-querier"
Oct 30 21:40:20.301770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.301759    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="48ae041d-366f-45cf-b667-a716570db0c3" containerName="thanos-querier"
Oct 30 21:40:20.304500 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.304484    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.363315 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.363284    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"]
Oct 30 21:40:20.449782 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.449743    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqx4x\" (UniqueName: \"kubernetes.io/projected/cd5004aa-88dd-4320-998b-09c72ab34d40-kube-api-access-lqx4x\") pod \"data-science-collector-targetallocator-799d86d86d-j5vgq\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.449782 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.449787    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd5004aa-88dd-4320-998b-09c72ab34d40-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-799d86d86d-j5vgq\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.450025 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.449814    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd5004aa-88dd-4320-998b-09c72ab34d40-ta-internal\") pod \"data-science-collector-targetallocator-799d86d86d-j5vgq\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.550789 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.550744    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd5004aa-88dd-4320-998b-09c72ab34d40-ta-internal\") pod \"data-science-collector-targetallocator-799d86d86d-j5vgq\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.550994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.550880    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqx4x\" (UniqueName: \"kubernetes.io/projected/cd5004aa-88dd-4320-998b-09c72ab34d40-kube-api-access-lqx4x\") pod \"data-science-collector-targetallocator-799d86d86d-j5vgq\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.550994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.550916    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd5004aa-88dd-4320-998b-09c72ab34d40-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-799d86d86d-j5vgq\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.551426 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.551376    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd5004aa-88dd-4320-998b-09c72ab34d40-ta-internal\") pod \"data-science-collector-targetallocator-799d86d86d-j5vgq\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.553484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.553465    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd5004aa-88dd-4320-998b-09c72ab34d40-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-799d86d86d-j5vgq\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.615321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.615286    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqx4x\" (UniqueName: \"kubernetes.io/projected/cd5004aa-88dd-4320-998b-09c72ab34d40-kube-api-access-lqx4x\") pod \"data-science-collector-targetallocator-799d86d86d-j5vgq\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.615478 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.615434    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:20.987173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.987143    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"]
Oct 30 21:40:20.990060 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:40:20.990033    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd5004aa_88dd_4320_998b_09c72ab34d40.slice/crio-86d8de284afb27d1f88ef8d25490fc604c3fd57168d5bd469c85b94a581707d8 WatchSource:0}: Error finding container 86d8de284afb27d1f88ef8d25490fc604c3fd57168d5bd469c85b94a581707d8: Status 404 returned error can't find the container with id 86d8de284afb27d1f88ef8d25490fc604c3fd57168d5bd469c85b94a581707d8
Oct 30 21:40:20.992235 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.992200    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:20.992298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:20.992262    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:21.579717 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:21.579679    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq" event={"ID":"cd5004aa-88dd-4320-998b-09c72ab34d40","Type":"ContainerStarted","Data":"6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928"}
Oct 30 21:40:21.580167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:21.579726    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq" event={"ID":"cd5004aa-88dd-4320-998b-09c72ab34d40","Type":"ContainerStarted","Data":"86d8de284afb27d1f88ef8d25490fc604c3fd57168d5bd469c85b94a581707d8"}
Oct 30 21:40:21.580167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:21.579842    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:21.580972 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:21.580948    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq" podUID="cd5004aa-88dd-4320-998b-09c72ab34d40" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.152:8080/readyz\": dial tcp 10.134.0.152:8080: connect: connection refused"
Oct 30 21:40:22.584392 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:22.584363    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:22.703754 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:22.703703    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq" podStartSLOduration=2.7036903260000003 podStartE2EDuration="2.703690326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:21.719950975 +0000 UTC m=+3796.675965748" watchObservedRunningTime="2026-10-30 21:40:22.703690326 +0000 UTC m=+3797.659705099"
Oct 30 21:40:22.754389 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:22.754360    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"]
Oct 30 21:40:22.754589 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:22.754563    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs" podUID="2e6b5fe3-8ced-442a-97fa-c0f0ad302777" containerName="ta-container" containerID="cri-o://1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58" gracePeriod=30
Oct 30 21:40:22.800676 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:40:22.800636    5937 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e6b5fe3_8ced_442a_97fa_c0f0ad302777.slice/crio-1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e6b5fe3_8ced_442a_97fa_c0f0ad302777.slice/crio-conmon-1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58.scope\": RecentStats: unable to find data in memory cache]"
Oct 30 21:40:23.016855 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.016830    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:40:23.173767 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.173689    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-kube-api-access-t55sb\" (UniqueName: \"kubernetes.io/projected/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-kube-api-access-t55sb\") pod \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") "
Oct 30 21:40:23.173767 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.173736    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-ta-internal\") pod \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") "
Oct 30 21:40:23.173955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.173822    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-data-science-collector-ta-server-cert\") pod \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\" (UID: \"2e6b5fe3-8ced-442a-97fa-c0f0ad302777\") "
Oct 30 21:40:23.174137 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.174113    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-ta-internal" pod "2e6b5fe3-8ced-442a-97fa-c0f0ad302777" (UID: "2e6b5fe3-8ced-442a-97fa-c0f0ad302777"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:40:23.176071 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.176046    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-data-science-collector-ta-server-cert" pod "2e6b5fe3-8ced-442a-97fa-c0f0ad302777" (UID: "2e6b5fe3-8ced-442a-97fa-c0f0ad302777"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:23.176185 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.176078    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-kube-api-access-t55sb" pod "2e6b5fe3-8ced-442a-97fa-c0f0ad302777" (UID: "2e6b5fe3-8ced-442a-97fa-c0f0ad302777"). InnerVolumeSpecName "kube-api-access-t55sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:40:23.275618 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.275507    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t55sb\" (UniqueName: \"kubernetes.io/projected/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-kube-api-access-t55sb\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:23.275618 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.275572    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:23.275618 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.275592    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2e6b5fe3-8ced-442a-97fa-c0f0ad302777-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:23.588491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.588456    5937 generic.go:356] "Generic (PLEG): container finished" podID="2e6b5fe3-8ced-442a-97fa-c0f0ad302777" containerID="1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58" exitCode=0
Oct 30 21:40:23.589007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.588506    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"
Oct 30 21:40:23.589007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.588555    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs" event={"ID":"2e6b5fe3-8ced-442a-97fa-c0f0ad302777","Type":"ContainerDied","Data":"1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58"}
Oct 30 21:40:23.589007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.588604    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs" event={"ID":"2e6b5fe3-8ced-442a-97fa-c0f0ad302777","Type":"ContainerDied","Data":"44c514e9cacc80d22e10b8fadc02782e23474618aca2f6666e10f8744d13fb2d"}
Oct 30 21:40:23.589007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.588624    5937 scope.go:122] "RemoveContainer" containerID="1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58"
Oct 30 21:40:23.597427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.597410    5937 scope.go:122] "RemoveContainer" containerID="1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58"
Oct 30 21:40:23.597748 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:40:23.597731    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58\": container with ID starting with 1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58 not found: ID does not exist" containerID="1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58"
Oct 30 21:40:23.597799 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.597756    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58"} err="failed to get container status \"1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58\": rpc error: code = NotFound desc = could not find container \"1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58\": container with ID starting with 1165d08c4b5f5acc669f9cdb94165b60afbc1837cc01cc2a85f35bb68667fc58 not found: ID does not exist"
Oct 30 21:40:23.754905 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.754875    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"]
Oct 30 21:40:23.805367 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:23.805334    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6497495954-dh5qs"]
Oct 30 21:40:24.201477 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:24.201446    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:40:25.161831 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:25.161797    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e6b5fe3-8ced-442a-97fa-c0f0ad302777" path="/var/lib/kubelet/pods/2e6b5fe3-8ced-442a-97fa-c0f0ad302777/volumes"
Oct 30 21:40:34.201586 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:34.201525    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:40:44.200794 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:44.200749    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:40:45.673195 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:40:45.673162    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:40:52.170946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.170911    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"]
Oct 30 21:40:52.171374 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.171271    5937 cpu_manager.go:414] "containerMap: removing container" podUID="2e6b5fe3-8ced-442a-97fa-c0f0ad302777" containerName="ta-container"
Oct 30 21:40:52.171374 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.171282    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e6b5fe3-8ced-442a-97fa-c0f0ad302777" containerName="ta-container"
Oct 30 21:40:52.171374 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.171366    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e6b5fe3-8ced-442a-97fa-c0f0ad302777" containerName="ta-container"
Oct 30 21:40:52.174561 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.174524    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.232711 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.232674    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"]
Oct 30 21:40:52.240084 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.240055    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7fd7fcb4d5-b8knz\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.240270 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.240122    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn6cm\" (UniqueName: \"kubernetes.io/projected/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-kube-api-access-kn6cm\") pod \"data-science-collector-targetallocator-7fd7fcb4d5-b8knz\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.240270 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.240212    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-ta-internal\") pod \"data-science-collector-targetallocator-7fd7fcb4d5-b8knz\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.341090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.341056    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7fd7fcb4d5-b8knz\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.341298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.341115    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn6cm\" (UniqueName: \"kubernetes.io/projected/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-kube-api-access-kn6cm\") pod \"data-science-collector-targetallocator-7fd7fcb4d5-b8knz\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.341298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.341157    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-ta-internal\") pod \"data-science-collector-targetallocator-7fd7fcb4d5-b8knz\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.341903 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.341884    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-ta-internal\") pod \"data-science-collector-targetallocator-7fd7fcb4d5-b8knz\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.343785 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.343762    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7fd7fcb4d5-b8knz\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.403581 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.403530    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn6cm\" (UniqueName: \"kubernetes.io/projected/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-kube-api-access-kn6cm\") pod \"data-science-collector-targetallocator-7fd7fcb4d5-b8knz\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.486655 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.486627    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:52.859606 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.859578    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"]
Oct 30 21:40:52.862282 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:40:52.862255    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6bcd815_76f7_4c5e_b539_04eb09cd9f7a.slice/crio-3a50c39818a9864ae7c8e85898cda475f92830613390897afe3793293792d2ab WatchSource:0}: Error finding container 3a50c39818a9864ae7c8e85898cda475f92830613390897afe3793293792d2ab: Status 404 returned error can't find the container with id 3a50c39818a9864ae7c8e85898cda475f92830613390897afe3793293792d2ab
Oct 30 21:40:52.865109 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.865071    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:52.865248 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:52.865147    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:40:53.726501 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:53.726460    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz" event={"ID":"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a","Type":"ContainerStarted","Data":"eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547"}
Oct 30 21:40:53.726501 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:53.726506    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz" event={"ID":"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a","Type":"ContainerStarted","Data":"3a50c39818a9864ae7c8e85898cda475f92830613390897afe3793293792d2ab"}
Oct 30 21:40:53.726995 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:53.726644    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:53.727845 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:53.727822    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz" podUID="d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.153:8080/readyz\": dial tcp 10.134.0.153:8080: connect: connection refused"
Oct 30 21:40:53.846474 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:53.846413    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz" podStartSLOduration=1.846397402 podStartE2EDuration="1.846397402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:53.84575282 +0000 UTC m=+3828.801767624" watchObservedRunningTime="2026-10-30 21:40:53.846397402 +0000 UTC m=+3828.802412178"
Oct 30 21:40:54.202258 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:54.202171    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:40:54.732134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:54.732107    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:40:54.902324 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:54.902288    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"]
Oct 30 21:40:54.902579 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:54.902525    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq" podUID="cd5004aa-88dd-4320-998b-09c72ab34d40" containerName="ta-container" containerID="cri-o://6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928" gracePeriod=30
Oct 30 21:40:55.172718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.172685    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:55.266714 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.266674    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cd5004aa-88dd-4320-998b-09c72ab34d40-ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd5004aa-88dd-4320-998b-09c72ab34d40-ta-internal\") pod \"cd5004aa-88dd-4320-998b-09c72ab34d40\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") "
Oct 30 21:40:55.266902 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.266792    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd5004aa-88dd-4320-998b-09c72ab34d40-kube-api-access-lqx4x\" (UniqueName: \"kubernetes.io/projected/cd5004aa-88dd-4320-998b-09c72ab34d40-kube-api-access-lqx4x\") pod \"cd5004aa-88dd-4320-998b-09c72ab34d40\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") "
Oct 30 21:40:55.266946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.266912    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd5004aa-88dd-4320-998b-09c72ab34d40-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd5004aa-88dd-4320-998b-09c72ab34d40-data-science-collector-ta-server-cert\") pod \"cd5004aa-88dd-4320-998b-09c72ab34d40\" (UID: \"cd5004aa-88dd-4320-998b-09c72ab34d40\") "
Oct 30 21:40:55.267141 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.267115    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd5004aa-88dd-4320-998b-09c72ab34d40-ta-internal" pod "cd5004aa-88dd-4320-998b-09c72ab34d40" (UID: "cd5004aa-88dd-4320-998b-09c72ab34d40"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:40:55.269145 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.269117    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd5004aa-88dd-4320-998b-09c72ab34d40-kube-api-access-lqx4x" pod "cd5004aa-88dd-4320-998b-09c72ab34d40" (UID: "cd5004aa-88dd-4320-998b-09c72ab34d40"). InnerVolumeSpecName "kube-api-access-lqx4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:40:55.269214 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.269170    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd5004aa-88dd-4320-998b-09c72ab34d40-data-science-collector-ta-server-cert" pod "cd5004aa-88dd-4320-998b-09c72ab34d40" (UID: "cd5004aa-88dd-4320-998b-09c72ab34d40"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:40:55.367811 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.367770    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqx4x\" (UniqueName: \"kubernetes.io/projected/cd5004aa-88dd-4320-998b-09c72ab34d40-kube-api-access-lqx4x\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:55.367811 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.367804    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/cd5004aa-88dd-4320-998b-09c72ab34d40-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:55.367811 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.367816    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/cd5004aa-88dd-4320-998b-09c72ab34d40-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:55.736807 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.736775    5937 generic.go:356] "Generic (PLEG): container finished" podID="cd5004aa-88dd-4320-998b-09c72ab34d40" containerID="6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928" exitCode=0
Oct 30 21:40:55.737280 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.736821    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"
Oct 30 21:40:55.737280 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.736859    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq" event={"ID":"cd5004aa-88dd-4320-998b-09c72ab34d40","Type":"ContainerDied","Data":"6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928"}
Oct 30 21:40:55.737280 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.736898    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq" event={"ID":"cd5004aa-88dd-4320-998b-09c72ab34d40","Type":"ContainerDied","Data":"86d8de284afb27d1f88ef8d25490fc604c3fd57168d5bd469c85b94a581707d8"}
Oct 30 21:40:55.737280 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.736914    5937 scope.go:122] "RemoveContainer" containerID="6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928"
Oct 30 21:40:55.745747 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.745726    5937 scope.go:122] "RemoveContainer" containerID="6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928"
Oct 30 21:40:55.746034 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:40:55.746014    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928\": container with ID starting with 6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928 not found: ID does not exist" containerID="6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928"
Oct 30 21:40:55.746078 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.746042    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928"} err="failed to get container status \"6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928\": rpc error: code = NotFound desc = could not find container \"6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928\": container with ID starting with 6a91419766552dbecd945705a4bdb27d926ba0722b2d33b0e73bfd4812fa1928 not found: ID does not exist"
Oct 30 21:40:55.903611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.903575    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"]
Oct 30 21:40:55.954133 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:55.954104    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-799d86d86d-j5vgq"]
Oct 30 21:40:57.161831 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:40:57.161799    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd5004aa-88dd-4320-998b-09c72ab34d40" path="/var/lib/kubelet/pods/cd5004aa-88dd-4320-998b-09c72ab34d40/volumes"
Oct 30 21:41:04.201365 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:04.201327    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:41:14.201702 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:14.201667    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:41:15.670786 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:41:15.670742    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:41:24.201449 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:24.201412    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:41:34.201616 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:34.201571    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:41:35.404808 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.404775    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"]
Oct 30 21:41:35.405175 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.405138    5937 cpu_manager.go:414] "containerMap: removing container" podUID="cd5004aa-88dd-4320-998b-09c72ab34d40" containerName="ta-container"
Oct 30 21:41:35.405175 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.405149    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd5004aa-88dd-4320-998b-09c72ab34d40" containerName="ta-container"
Oct 30 21:41:35.405249 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.405212    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd5004aa-88dd-4320-998b-09c72ab34d40" containerName="ta-container"
Oct 30 21:41:35.408325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.408308    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.410050 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.410025    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-ta-internal\") pod \"data-science-collector-targetallocator-759747fbcd-t6dr9\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.410157 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.410076    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v94d9\" (UniqueName: \"kubernetes.io/projected/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-kube-api-access-v94d9\") pod \"data-science-collector-targetallocator-759747fbcd-t6dr9\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.410157 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.410133    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-759747fbcd-t6dr9\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.466676 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.466647    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"]
Oct 30 21:41:35.511650 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.511624    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v94d9\" (UniqueName: \"kubernetes.io/projected/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-kube-api-access-v94d9\") pod \"data-science-collector-targetallocator-759747fbcd-t6dr9\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.511749 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.511672    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-759747fbcd-t6dr9\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.511749 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.511739    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-ta-internal\") pod \"data-science-collector-targetallocator-759747fbcd-t6dr9\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.512431 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.512412    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-ta-internal\") pod \"data-science-collector-targetallocator-759747fbcd-t6dr9\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.514450 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.514420    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-759747fbcd-t6dr9\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.573844 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.573820    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v94d9\" (UniqueName: \"kubernetes.io/projected/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-kube-api-access-v94d9\") pod \"data-science-collector-targetallocator-759747fbcd-t6dr9\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:35.719905 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:35.719883    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:36.090645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:36.090556    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"]
Oct 30 21:41:36.097364 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:41:36.097335    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae7c1ef3_1d1e_4d0f_b683_6cdfe1c04b07.slice/crio-8ede1ccac46ddfb175b3f82e085b419ec3dd0e2f6f0226fdbc7276a63acb271a WatchSource:0}: Error finding container 8ede1ccac46ddfb175b3f82e085b419ec3dd0e2f6f0226fdbc7276a63acb271a: Status 404 returned error can't find the container with id 8ede1ccac46ddfb175b3f82e085b419ec3dd0e2f6f0226fdbc7276a63acb271a
Oct 30 21:41:36.099589 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:36.099532    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:41:36.099685 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:36.099645    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:41:36.921455 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:36.921419    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9" event={"ID":"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07","Type":"ContainerStarted","Data":"f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743"}
Oct 30 21:41:36.921897 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:36.921467    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9" event={"ID":"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07","Type":"ContainerStarted","Data":"8ede1ccac46ddfb175b3f82e085b419ec3dd0e2f6f0226fdbc7276a63acb271a"}
Oct 30 21:41:36.921897 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:36.921663    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:36.922559 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:36.922517    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9" podUID="ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.154:8080/readyz\": dial tcp 10.134.0.154:8080: connect: connection refused"
Oct 30 21:41:37.041810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:37.041762    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9" podStartSLOduration=2.041748391 podStartE2EDuration="2.041748391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:41:37.041017051 +0000 UTC m=+3871.997031847" watchObservedRunningTime="2026-10-30 21:41:37.041748391 +0000 UTC m=+3871.997763238"
Oct 30 21:41:37.927004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:37.926977    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:38.096483 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.096454    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"]
Oct 30 21:41:38.096715 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.096688    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz" podUID="d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" containerName="ta-container" containerID="cri-o://eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547" gracePeriod=30
Oct 30 21:41:38.357735 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.357713    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:41:38.433076 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.433048    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-kube-api-access-kn6cm\" (UniqueName: \"kubernetes.io/projected/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-kube-api-access-kn6cm\") pod \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") "
Oct 30 21:41:38.433219 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.433083    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-ta-internal\" (UniqueName: \"kubernetes.io/configmap/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-ta-internal\") pod \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") "
Oct 30 21:41:38.433219 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.433110    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-data-science-collector-ta-server-cert\") pod \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\" (UID: \"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a\") "
Oct 30 21:41:38.433442 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.433419    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-ta-internal" pod "d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" (UID: "d6bcd815-76f7-4c5e-b539-04eb09cd9f7a"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:38.435259 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.435234    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-data-science-collector-ta-server-cert" pod "d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" (UID: "d6bcd815-76f7-4c5e-b539-04eb09cd9f7a"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:38.435346 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.435295    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-kube-api-access-kn6cm" pod "d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" (UID: "d6bcd815-76f7-4c5e-b539-04eb09cd9f7a"). InnerVolumeSpecName "kube-api-access-kn6cm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:38.534201 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.534140    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn6cm\" (UniqueName: \"kubernetes.io/projected/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-kube-api-access-kn6cm\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:38.534201 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.534163    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:38.534201 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.534173    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:38.931558 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.931456    5937 generic.go:356] "Generic (PLEG): container finished" podID="d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" containerID="eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547" exitCode=0
Oct 30 21:41:38.931558 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.931510    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"
Oct 30 21:41:38.932067 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.931556    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz" event={"ID":"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a","Type":"ContainerDied","Data":"eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547"}
Oct 30 21:41:38.932067 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.931605    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz" event={"ID":"d6bcd815-76f7-4c5e-b539-04eb09cd9f7a","Type":"ContainerDied","Data":"3a50c39818a9864ae7c8e85898cda475f92830613390897afe3793293792d2ab"}
Oct 30 21:41:38.932067 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.931627    5937 scope.go:122] "RemoveContainer" containerID="eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547"
Oct 30 21:41:38.940608 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.940587    5937 scope.go:122] "RemoveContainer" containerID="eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547"
Oct 30 21:41:38.940877 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:41:38.940856    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547\": container with ID starting with eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547 not found: ID does not exist" containerID="eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547"
Oct 30 21:41:38.940928 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:38.940887    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547"} err="failed to get container status \"eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547\": rpc error: code = NotFound desc = could not find container \"eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547\": container with ID starting with eda1d2b4686fdd7a0498483c84b88593dcd6d05bb8cf383fa201e6ad4b124547 not found: ID does not exist"
Oct 30 21:41:39.099885 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:39.099852    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"]
Oct 30 21:41:39.150425 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:39.150388    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7fd7fcb4d5-b8knz"]
Oct 30 21:41:39.161310 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:39.161280    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" path="/var/lib/kubelet/pods/d6bcd815-76f7-4c5e-b539-04eb09cd9f7a/volumes"
Oct 30 21:41:44.201370 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:44.201334    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:41:45.671832 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:41:45.671794    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:41:54.201650 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:54.201615    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:41:56.316459 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.316410    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"]
Oct 30 21:41:56.317039 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.316629    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9" podUID="ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" containerName="ta-container" containerID="cri-o://f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743" gracePeriod=30
Oct 30 21:41:56.575680 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.575621    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:56.683726 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.683698    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-kube-api-access-v94d9\" (UniqueName: \"kubernetes.io/projected/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-kube-api-access-v94d9\") pod \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") "
Oct 30 21:41:56.683891 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.683793    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-data-science-collector-ta-server-cert\") pod \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") "
Oct 30 21:41:56.683891 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.683847    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-ta-internal\") pod \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\" (UID: \"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07\") "
Oct 30 21:41:56.684658 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.684624    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-ta-internal" pod "ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" (UID: "ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:56.686354 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.686325    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-data-science-collector-ta-server-cert" pod "ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" (UID: "ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:41:56.686354 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.686346    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-kube-api-access-v94d9" pod "ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" (UID: "ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07"). InnerVolumeSpecName "kube-api-access-v94d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:56.702183 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.702148    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:41:56.702359 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.702336    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="e9c9719d-e029-4e49-93be-144bcc71ee3f" containerName="perses" containerID="cri-o://3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf" gracePeriod=30
Oct 30 21:41:56.785821 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.785794    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:56.785821 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.785819    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:56.785980 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.785829    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v94d9\" (UniqueName: \"kubernetes.io/projected/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07-kube-api-access-v94d9\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:56.953296 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.953272    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:41:56.987501 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.987471    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"e9c9719d-e029-4e49-93be-144bcc71ee3f\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") "
Oct 30 21:41:56.987697 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.987581    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e9c9719d-e029-4e49-93be-144bcc71ee3f-plugins\" (UniqueName: \"kubernetes.io/empty-dir/e9c9719d-e029-4e49-93be-144bcc71ee3f-plugins\") pod \"e9c9719d-e029-4e49-93be-144bcc71ee3f\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") "
Oct 30 21:41:56.987697 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.987642    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e9c9719d-e029-4e49-93be-144bcc71ee3f-config\" (UniqueName: \"kubernetes.io/configmap/e9c9719d-e029-4e49-93be-144bcc71ee3f-config\") pod \"e9c9719d-e029-4e49-93be-144bcc71ee3f\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") "
Oct 30 21:41:56.987697 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.987671    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e9c9719d-e029-4e49-93be-144bcc71ee3f-kube-api-access-4rhtv\" (UniqueName: \"kubernetes.io/projected/e9c9719d-e029-4e49-93be-144bcc71ee3f-kube-api-access-4rhtv\") pod \"e9c9719d-e029-4e49-93be-144bcc71ee3f\" (UID: \"e9c9719d-e029-4e49-93be-144bcc71ee3f\") "
Oct 30 21:41:56.988079 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.988048    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9c9719d-e029-4e49-93be-144bcc71ee3f-config" pod "e9c9719d-e029-4e49-93be-144bcc71ee3f" (UID: "e9c9719d-e029-4e49-93be-144bcc71ee3f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:41:56.990097 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.990062    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9c9719d-e029-4e49-93be-144bcc71ee3f-kube-api-access-4rhtv" pod "e9c9719d-e029-4e49-93be-144bcc71ee3f" (UID: "e9c9719d-e029-4e49-93be-144bcc71ee3f"). InnerVolumeSpecName "kube-api-access-4rhtv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:41:56.990625 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:56.990601    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "e9c9719d-e029-4e49-93be-144bcc71ee3f" (UID: "e9c9719d-e029-4e49-93be-144bcc71ee3f"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:41:57.010553 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.010519    5937 generic.go:356] "Generic (PLEG): container finished" podID="ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" containerID="f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743" exitCode=0
Oct 30 21:41:57.010662 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.010591    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"
Oct 30 21:41:57.010662 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.010605    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9" event={"ID":"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07","Type":"ContainerDied","Data":"f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743"}
Oct 30 21:41:57.010662 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.010652    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9" event={"ID":"ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07","Type":"ContainerDied","Data":"8ede1ccac46ddfb175b3f82e085b419ec3dd0e2f6f0226fdbc7276a63acb271a"}
Oct 30 21:41:57.010823 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.010675    5937 scope.go:122] "RemoveContainer" containerID="f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743"
Oct 30 21:41:57.012375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.012321    5937 generic.go:356] "Generic (PLEG): container finished" podID="e9c9719d-e029-4e49-93be-144bcc71ee3f" containerID="3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf" exitCode=0
Oct 30 21:41:57.012375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.012361    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:41:57.012375 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.012371    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e9c9719d-e029-4e49-93be-144bcc71ee3f","Type":"ContainerDied","Data":"3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf"}
Oct 30 21:41:57.012625 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.012400    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"e9c9719d-e029-4e49-93be-144bcc71ee3f","Type":"ContainerDied","Data":"0f98813faaa271a53496c526504459fdc6293cf187a4bd8fd3c1e59b1c198623"}
Oct 30 21:41:57.020531 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.020514    5937 scope.go:122] "RemoveContainer" containerID="f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743"
Oct 30 21:41:57.020820 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:41:57.020792    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743\": container with ID starting with f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743 not found: ID does not exist" containerID="f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743"
Oct 30 21:41:57.020906 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.020821    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743"} err="failed to get container status \"f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743\": rpc error: code = NotFound desc = could not find container \"f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743\": container with ID starting with f47420e4dabe65174ce7bcc435e04e185390a1a6cbf615c88eeac3860ca4e743 not found: ID does not exist"
Oct 30 21:41:57.020906 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.020839    5937 scope.go:122] "RemoveContainer" containerID="3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf"
Oct 30 21:41:57.028915 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.028898    5937 scope.go:122] "RemoveContainer" containerID="3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf"
Oct 30 21:41:57.029178 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:41:57.029162    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf\": container with ID starting with 3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf not found: ID does not exist" containerID="3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf"
Oct 30 21:41:57.029227 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.029186    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf"} err="failed to get container status \"3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf\": rpc error: code = NotFound desc = could not find container \"3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf\": container with ID starting with 3ad27f6512f24c264b79777b8931f5222c793a75e461b21c44b5a1711e981bcf not found: ID does not exist"
Oct 30 21:41:57.088784 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.088758    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:41:57.088784 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.088782    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9c9719d-e029-4e49-93be-144bcc71ee3f-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:57.089007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.088792    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rhtv\" (UniqueName: \"kubernetes.io/projected/e9c9719d-e029-4e49-93be-144bcc71ee3f-kube-api-access-4rhtv\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:57.102382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.102365    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:41:57.144990 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.144920    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9c9719d-e029-4e49-93be-144bcc71ee3f-plugins" pod "e9c9719d-e029-4e49-93be-144bcc71ee3f" (UID: "e9c9719d-e029-4e49-93be-144bcc71ee3f"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:41:57.185758 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.185726    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"]
Oct 30 21:41:57.190119 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.190097    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:41:57.190119 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.190119    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/e9c9719d-e029-4e49-93be-144bcc71ee3f-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:41:57.196997 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.196976    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-759747fbcd-t6dr9"]
Oct 30 21:41:57.430764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.430713    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:41:57.434525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:57.434505    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:41:59.160828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:59.160797    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" path="/var/lib/kubelet/pods/ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07/volumes"
Oct 30 21:41:59.161193 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:41:59.161173    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e9c9719d-e029-4e49-93be-144bcc71ee3f" path="/var/lib/kubelet/pods/e9c9719d-e029-4e49-93be-144bcc71ee3f/volumes"
Oct 30 21:42:04.201260 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:04.201225    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:42:14.201500 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.201466    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:42:14.317226 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317192    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"]
Oct 30 21:42:14.317773 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317753    5937 cpu_manager.go:414] "containerMap: removing container" podUID="ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" containerName="ta-container"
Oct 30 21:42:14.317846 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317777    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" containerName="ta-container"
Oct 30 21:42:14.317846 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317819    5937 cpu_manager.go:414] "containerMap: removing container" podUID="e9c9719d-e029-4e49-93be-144bcc71ee3f" containerName="perses"
Oct 30 21:42:14.317846 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317827    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e9c9719d-e029-4e49-93be-144bcc71ee3f" containerName="perses"
Oct 30 21:42:14.317937 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317851    5937 cpu_manager.go:414] "containerMap: removing container" podUID="d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" containerName="ta-container"
Oct 30 21:42:14.317937 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317858    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" containerName="ta-container"
Oct 30 21:42:14.317937 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317934    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae7c1ef3-1d1e-4d0f-b683-6cdfe1c04b07" containerName="ta-container"
Oct 30 21:42:14.318052 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317945    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="e9c9719d-e029-4e49-93be-144bcc71ee3f" containerName="perses"
Oct 30 21:42:14.318052 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.317952    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="d6bcd815-76f7-4c5e-b539-04eb09cd9f7a" containerName="ta-container"
Oct 30 21:42:14.320773 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.320754    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"
Oct 30 21:42:14.376914 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.376889    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"]
Oct 30 21:42:14.426764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.426746    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:42:14.433507 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.433485    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh6b2\" (UniqueName: \"kubernetes.io/projected/551a0aa5-116c-4906-a251-262ded49849e-kube-api-access-fh6b2\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj\" (UID: \"551a0aa5-116c-4906-a251-262ded49849e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"
Oct 30 21:42:14.534336 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.534310    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh6b2\" (UniqueName: \"kubernetes.io/projected/551a0aa5-116c-4906-a251-262ded49849e-kube-api-access-fh6b2\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj\" (UID: \"551a0aa5-116c-4906-a251-262ded49849e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"
Oct 30 21:42:14.602930 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.602910    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh6b2\" (UniqueName: \"kubernetes.io/projected/551a0aa5-116c-4906-a251-262ded49849e-kube-api-access-fh6b2\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj\" (UID: \"551a0aa5-116c-4906-a251-262ded49849e\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"
Oct 30 21:42:14.632557 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:14.632524    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"
Oct 30 21:42:15.001444 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:15.001251    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"]
Oct 30 21:42:15.004307 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:42:15.004259    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod551a0aa5_116c_4906_a251_262ded49849e.slice/crio-0ab3551eab34794be388d3a1f59e55737fbfa8e6ccec755b4c2e0043c2e473f7 WatchSource:0}: Error finding container 0ab3551eab34794be388d3a1f59e55737fbfa8e6ccec755b4c2e0043c2e473f7: Status 404 returned error can't find the container with id 0ab3551eab34794be388d3a1f59e55737fbfa8e6ccec755b4c2e0043c2e473f7
Oct 30 21:42:15.096088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:15.096054    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj" event={"ID":"551a0aa5-116c-4906-a251-262ded49849e","Type":"ContainerStarted","Data":"2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906"}
Oct 30 21:42:15.096244 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:15.096102    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj" event={"ID":"551a0aa5-116c-4906-a251-262ded49849e","Type":"ContainerStarted","Data":"0ab3551eab34794be388d3a1f59e55737fbfa8e6ccec755b4c2e0043c2e473f7"}
Oct 30 21:42:15.672566 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:42:15.672511    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:42:17.656494 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.656434    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj" podStartSLOduration=3.656418987 podStartE2EDuration="3.656418987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:15.213237848 +0000 UTC m=+3910.169252625" watchObservedRunningTime="2026-10-30 21:42:17.656418987 +0000 UTC m=+3912.612433760"
Oct 30 21:42:17.656912 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.656702    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:42:17.659841 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.659824    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:17.720713 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.720684    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:42:17.765555 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.765513    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:42:17.846731 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.846701    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"]
Oct 30 21:42:17.850122 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.850107    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:17.864015 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.863994    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f7ce75ae-e92f-4796-9500-b356c44a0685-plugins\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:17.864117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.864022    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4snkw\" (UniqueName: \"kubernetes.io/projected/f7ce75ae-e92f-4796-9500-b356c44a0685-kube-api-access-4snkw\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:17.864117 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.864095    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ce75ae-e92f-4796-9500-b356c44a0685-config\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:17.904792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.904772    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:42:17.904792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.904770    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-gt2gv\""
Oct 30 21:42:17.904974 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.904866    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:42:17.910106 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.910051    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"]
Oct 30 21:42:17.964993 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.964968    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ce75ae-e92f-4796-9500-b356c44a0685-config\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:17.965112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.965018    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9873d8dc-13aa-4168-892f-e0ed30fafdbc-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76f77b8948-sl4mt\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:17.965112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.965071    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f7ce75ae-e92f-4796-9500-b356c44a0685-plugins\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:17.965112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.965094    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4snkw\" (UniqueName: \"kubernetes.io/projected/f7ce75ae-e92f-4796-9500-b356c44a0685-kube-api-access-4snkw\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:17.965291 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.965177    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9873d8dc-13aa-4168-892f-e0ed30fafdbc-ta-internal\") pod \"data-science-collector-targetallocator-76f77b8948-sl4mt\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:17.965291 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.965223    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kspc7\" (UniqueName: \"kubernetes.io/projected/9873d8dc-13aa-4168-892f-e0ed30fafdbc-kube-api-access-kspc7\") pod \"data-science-collector-targetallocator-76f77b8948-sl4mt\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:17.965599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.965580    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f7ce75ae-e92f-4796-9500-b356c44a0685-plugins\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:17.965724 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:17.965709    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ce75ae-e92f-4796-9500-b356c44a0685-config\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:18.028734 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.028710    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4snkw\" (UniqueName: \"kubernetes.io/projected/f7ce75ae-e92f-4796-9500-b356c44a0685-kube-api-access-4snkw\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:18.066796 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.066770    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9873d8dc-13aa-4168-892f-e0ed30fafdbc-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76f77b8948-sl4mt\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:18.066953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.066851    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9873d8dc-13aa-4168-892f-e0ed30fafdbc-ta-internal\") pod \"data-science-collector-targetallocator-76f77b8948-sl4mt\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:18.066953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.066877    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kspc7\" (UniqueName: \"kubernetes.io/projected/9873d8dc-13aa-4168-892f-e0ed30fafdbc-kube-api-access-kspc7\") pod \"data-science-collector-targetallocator-76f77b8948-sl4mt\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:18.067496 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.067468    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9873d8dc-13aa-4168-892f-e0ed30fafdbc-ta-internal\") pod \"data-science-collector-targetallocator-76f77b8948-sl4mt\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:18.069254 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.069235    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9873d8dc-13aa-4168-892f-e0ed30fafdbc-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-76f77b8948-sl4mt\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:18.129250 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.129218    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kspc7\" (UniqueName: \"kubernetes.io/projected/9873d8dc-13aa-4168-892f-e0ed30fafdbc-kube-api-access-kspc7\") pod \"data-science-collector-targetallocator-76f77b8948-sl4mt\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:18.161600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.161525    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:18.534313 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.534277    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"]
Oct 30 21:42:18.537124 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:42:18.537096    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9873d8dc_13aa_4168_892f_e0ed30fafdbc.slice/crio-709dddf3a9adfa0ab11a05391b72478039ef0eeb69ee2d7ed11f98cced5d004f WatchSource:0}: Error finding container 709dddf3a9adfa0ab11a05391b72478039ef0eeb69ee2d7ed11f98cced5d004f: Status 404 returned error can't find the container with id 709dddf3a9adfa0ab11a05391b72478039ef0eeb69ee2d7ed11f98cced5d004f
Oct 30 21:42:18.539575 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.539530    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:42:18.539673 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:18.539601    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:42:19.114493 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:19.114457    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt" event={"ID":"9873d8dc-13aa-4168-892f-e0ed30fafdbc","Type":"ContainerStarted","Data":"6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252"}
Oct 30 21:42:19.114954 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:19.114505    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt" event={"ID":"9873d8dc-13aa-4168-892f-e0ed30fafdbc","Type":"ContainerStarted","Data":"709dddf3a9adfa0ab11a05391b72478039ef0eeb69ee2d7ed11f98cced5d004f"}
Oct 30 21:42:19.114954 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:19.114674    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:19.115826 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:19.115801    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt" podUID="9873d8dc-13aa-4168-892f-e0ed30fafdbc" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.157:8080/readyz\": dial tcp 10.134.0.157:8080: connect: connection refused"
Oct 30 21:42:19.235039 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:19.234985    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt" podStartSLOduration=2.234971818 podStartE2EDuration="2.234971818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:19.233867988 +0000 UTC m=+3914.189882776" watchObservedRunningTime="2026-10-30 21:42:19.234971818 +0000 UTC m=+3914.190986593"
Oct 30 21:42:20.119398 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:20.119370    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:42:21.201866 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:21.201831    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:21.308009 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:21.307972    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:21.403551 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:21.403514    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:21.403698 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:21.403655    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:21.456909 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:21.456885    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:21.596958 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:21.596924    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:21.666099 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:21.666071    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:21.871619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:21.871516    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:22.243012 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:22.242872    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:42:22.245566 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:42:22.245523    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7ce75ae_e92f_4796_9500_b356c44a0685.slice/crio-bc4b92de77717e5223ac5c95e0700385b1f84b4d6206a69da869c7d760e1f2a8 WatchSource:0}: Error finding container bc4b92de77717e5223ac5c95e0700385b1f84b4d6206a69da869c7d760e1f2a8: Status 404 returned error can't find the container with id bc4b92de77717e5223ac5c95e0700385b1f84b4d6206a69da869c7d760e1f2a8
Oct 30 21:42:23.133055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:23.133023    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f7ce75ae-e92f-4796-9500-b356c44a0685","Type":"ContainerStarted","Data":"da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235"}
Oct 30 21:42:23.133248 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:23.133067    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f7ce75ae-e92f-4796-9500-b356c44a0685","Type":"ContainerStarted","Data":"bc4b92de77717e5223ac5c95e0700385b1f84b4d6206a69da869c7d760e1f2a8"}
Oct 30 21:42:23.133248 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:23.133174    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:23.252761 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:23.252700    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=6.252683667 podStartE2EDuration="6.252683667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:42:23.251794309 +0000 UTC m=+3918.207809085" watchObservedRunningTime="2026-10-30 21:42:23.252683667 +0000 UTC m=+3918.208698466"
Oct 30 21:42:24.202864 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:24.202826    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:42:31.349767 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:31.349738    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"]
Oct 30 21:42:31.350220 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:31.349898    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj" podUID="551a0aa5-116c-4906-a251-262ded49849e" containerName="thanos-querier" containerID="cri-o://2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906" gracePeriod=30
Oct 30 21:42:31.606919 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:31.606859    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"
Oct 30 21:42:31.686047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:31.686022    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/551a0aa5-116c-4906-a251-262ded49849e-kube-api-access-fh6b2\" (UniqueName: \"kubernetes.io/projected/551a0aa5-116c-4906-a251-262ded49849e-kube-api-access-fh6b2\") pod \"551a0aa5-116c-4906-a251-262ded49849e\" (UID: \"551a0aa5-116c-4906-a251-262ded49849e\") "
Oct 30 21:42:31.688136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:31.688102    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551a0aa5-116c-4906-a251-262ded49849e-kube-api-access-fh6b2" pod "551a0aa5-116c-4906-a251-262ded49849e" (UID: "551a0aa5-116c-4906-a251-262ded49849e"). InnerVolumeSpecName "kube-api-access-fh6b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:31.786907 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:31.786878    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh6b2\" (UniqueName: \"kubernetes.io/projected/551a0aa5-116c-4906-a251-262ded49849e-kube-api-access-fh6b2\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:32.174296 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:32.174257    5937 generic.go:356] "Generic (PLEG): container finished" podID="551a0aa5-116c-4906-a251-262ded49849e" containerID="2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906" exitCode=0
Oct 30 21:42:32.174487 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:32.174382    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"
Oct 30 21:42:32.174487 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:32.174385    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj" event={"ID":"551a0aa5-116c-4906-a251-262ded49849e","Type":"ContainerDied","Data":"2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906"}
Oct 30 21:42:32.174659 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:32.174496    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj" event={"ID":"551a0aa5-116c-4906-a251-262ded49849e","Type":"ContainerDied","Data":"0ab3551eab34794be388d3a1f59e55737fbfa8e6ccec755b4c2e0043c2e473f7"}
Oct 30 21:42:32.174659 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:32.174519    5937 scope.go:122] "RemoveContainer" containerID="2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906"
Oct 30 21:42:32.183948 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:32.183929    5937 scope.go:122] "RemoveContainer" containerID="2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906"
Oct 30 21:42:32.184245 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:42:32.184222    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906\": container with ID starting with 2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906 not found: ID does not exist" containerID="2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906"
Oct 30 21:42:32.184290 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:32.184256    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906"} err="failed to get container status \"2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906\": rpc error: code = NotFound desc = could not find container \"2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906\": container with ID starting with 2031aebb1a6bbe08c35fb73b2695d86030e89ccbd7f4621a99c24157c5869906 not found: ID does not exist"
Oct 30 21:42:32.342949 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:32.342915    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"]
Oct 30 21:42:32.347213 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:32.347183    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-56zrj"]
Oct 30 21:42:33.161173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:33.161141    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="551a0aa5-116c-4906-a251-262ded49849e" path="/var/lib/kubelet/pods/551a0aa5-116c-4906-a251-262ded49849e/volumes"
Oct 30 21:42:34.140558 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:34.140519    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:42:34.201497 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:34.201455    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:42:44.200953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:44.200918    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:42:45.671968 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:42:45.671934    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:42:54.201058 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:42:54.201009    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:43:04.200922 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:04.200884    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:43:14.200590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:14.200525    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:43:15.671381 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:43:15.671345    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:43:16.104077 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.104047    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"]
Oct 30 21:43:16.104415 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.104402    5937 cpu_manager.go:414] "containerMap: removing container" podUID="551a0aa5-116c-4906-a251-262ded49849e" containerName="thanos-querier"
Oct 30 21:43:16.104463 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.104417    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="551a0aa5-116c-4906-a251-262ded49849e" containerName="thanos-querier"
Oct 30 21:43:16.104502 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.104476    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="551a0aa5-116c-4906-a251-262ded49849e" containerName="thanos-querier"
Oct 30 21:43:16.106006 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.105986    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.153927 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.153902    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9eb851c5-b0eb-432c-b651-ad991a5d48a2-ta-internal\") pod \"data-science-collector-targetallocator-5545cdb985-9tz4m\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.154035 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.153977    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9eb851c5-b0eb-432c-b651-ad991a5d48a2-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5545cdb985-9tz4m\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.154090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.154032    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qssl8\" (UniqueName: \"kubernetes.io/projected/9eb851c5-b0eb-432c-b651-ad991a5d48a2-kube-api-access-qssl8\") pod \"data-science-collector-targetallocator-5545cdb985-9tz4m\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.166158 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.166125    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"]
Oct 30 21:43:16.255079 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.255054    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9eb851c5-b0eb-432c-b651-ad991a5d48a2-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5545cdb985-9tz4m\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.255213 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.255084    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qssl8\" (UniqueName: \"kubernetes.io/projected/9eb851c5-b0eb-432c-b651-ad991a5d48a2-kube-api-access-qssl8\") pod \"data-science-collector-targetallocator-5545cdb985-9tz4m\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.255213 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.255126    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9eb851c5-b0eb-432c-b651-ad991a5d48a2-ta-internal\") pod \"data-science-collector-targetallocator-5545cdb985-9tz4m\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.255781 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.255762    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9eb851c5-b0eb-432c-b651-ad991a5d48a2-ta-internal\") pod \"data-science-collector-targetallocator-5545cdb985-9tz4m\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.257583 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.257563    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9eb851c5-b0eb-432c-b651-ad991a5d48a2-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5545cdb985-9tz4m\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.317361 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.317338    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qssl8\" (UniqueName: \"kubernetes.io/projected/9eb851c5-b0eb-432c-b651-ad991a5d48a2-kube-api-access-qssl8\") pod \"data-science-collector-targetallocator-5545cdb985-9tz4m\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.416661 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.416598    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:16.796069 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.796044    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"]
Oct 30 21:43:16.798790 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:43:16.798745    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9eb851c5_b0eb_432c_b651_ad991a5d48a2.slice/crio-b00e88d4b586a77e31139e4d80c6a59e89c9555102c5ee87a8a427600ece4245 WatchSource:0}: Error finding container b00e88d4b586a77e31139e4d80c6a59e89c9555102c5ee87a8a427600ece4245: Status 404 returned error can't find the container with id b00e88d4b586a77e31139e4d80c6a59e89c9555102c5ee87a8a427600ece4245
Oct 30 21:43:16.800975 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.800942    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:43:16.801082 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:16.801018    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:43:17.383583 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:17.383549    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m" event={"ID":"9eb851c5-b0eb-432c-b651-ad991a5d48a2","Type":"ContainerStarted","Data":"b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30"}
Oct 30 21:43:17.383764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:17.383592    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m" event={"ID":"9eb851c5-b0eb-432c-b651-ad991a5d48a2","Type":"ContainerStarted","Data":"b00e88d4b586a77e31139e4d80c6a59e89c9555102c5ee87a8a427600ece4245"}
Oct 30 21:43:17.383764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:17.383683    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:17.384885 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:17.384858    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m" podUID="9eb851c5-b0eb-432c-b651-ad991a5d48a2" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.158:8080/readyz\": dial tcp 10.134.0.158:8080: connect: connection refused"
Oct 30 21:43:17.505195 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:17.505110    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m" podStartSLOduration=1.505093998 podStartE2EDuration="1.505093998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:17.504834988 +0000 UTC m=+3972.460849766" watchObservedRunningTime="2026-10-30 21:43:17.505093998 +0000 UTC m=+3972.461108771"
Oct 30 21:43:18.389280 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.389249    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:18.572059 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.572017    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"]
Oct 30 21:43:18.572281 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.572256    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt" podUID="9873d8dc-13aa-4168-892f-e0ed30fafdbc" containerName="ta-container" containerID="cri-o://6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252" gracePeriod=30
Oct 30 21:43:18.819778 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.819752    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:43:18.878965 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.878942    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9873d8dc-13aa-4168-892f-e0ed30fafdbc-ta-internal\" (UniqueName: \"kubernetes.io/configmap/9873d8dc-13aa-4168-892f-e0ed30fafdbc-ta-internal\") pod \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") "
Oct 30 21:43:18.879074 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.879038    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9873d8dc-13aa-4168-892f-e0ed30fafdbc-kube-api-access-kspc7\" (UniqueName: \"kubernetes.io/projected/9873d8dc-13aa-4168-892f-e0ed30fafdbc-kube-api-access-kspc7\") pod \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") "
Oct 30 21:43:18.879129 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.879113    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9873d8dc-13aa-4168-892f-e0ed30fafdbc-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9873d8dc-13aa-4168-892f-e0ed30fafdbc-data-science-collector-ta-server-cert\") pod \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\" (UID: \"9873d8dc-13aa-4168-892f-e0ed30fafdbc\") "
Oct 30 21:43:18.879339 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.879321    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9873d8dc-13aa-4168-892f-e0ed30fafdbc-ta-internal" pod "9873d8dc-13aa-4168-892f-e0ed30fafdbc" (UID: "9873d8dc-13aa-4168-892f-e0ed30fafdbc"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:18.881303 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.881282    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9873d8dc-13aa-4168-892f-e0ed30fafdbc-kube-api-access-kspc7" pod "9873d8dc-13aa-4168-892f-e0ed30fafdbc" (UID: "9873d8dc-13aa-4168-892f-e0ed30fafdbc"). InnerVolumeSpecName "kube-api-access-kspc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:43:18.881380 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.881304    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9873d8dc-13aa-4168-892f-e0ed30fafdbc-data-science-collector-ta-server-cert" pod "9873d8dc-13aa-4168-892f-e0ed30fafdbc" (UID: "9873d8dc-13aa-4168-892f-e0ed30fafdbc"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:18.979955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.979927    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9873d8dc-13aa-4168-892f-e0ed30fafdbc-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:18.979955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.979954    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kspc7\" (UniqueName: \"kubernetes.io/projected/9873d8dc-13aa-4168-892f-e0ed30fafdbc-kube-api-access-kspc7\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:18.980112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:18.979971    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9873d8dc-13aa-4168-892f-e0ed30fafdbc-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:19.393944 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:19.393857    5937 generic.go:356] "Generic (PLEG): container finished" podID="9873d8dc-13aa-4168-892f-e0ed30fafdbc" containerID="6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252" exitCode=0
Oct 30 21:43:19.393944 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:19.393897    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"
Oct 30 21:43:19.394406 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:19.393947    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt" event={"ID":"9873d8dc-13aa-4168-892f-e0ed30fafdbc","Type":"ContainerDied","Data":"6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252"}
Oct 30 21:43:19.394406 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:19.393995    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt" event={"ID":"9873d8dc-13aa-4168-892f-e0ed30fafdbc","Type":"ContainerDied","Data":"709dddf3a9adfa0ab11a05391b72478039ef0eeb69ee2d7ed11f98cced5d004f"}
Oct 30 21:43:19.394406 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:19.394012    5937 scope.go:122] "RemoveContainer" containerID="6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252"
Oct 30 21:43:19.402154 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:19.402138    5937 scope.go:122] "RemoveContainer" containerID="6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252"
Oct 30 21:43:19.402422 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:43:19.402404    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252\": container with ID starting with 6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252 not found: ID does not exist" containerID="6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252"
Oct 30 21:43:19.402460 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:19.402431    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252"} err="failed to get container status \"6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252\": rpc error: code = NotFound desc = could not find container \"6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252\": container with ID starting with 6d54f752c2cc59bd1880d13715e2352c70d8547510b819a700335128809cd252 not found: ID does not exist"
Oct 30 21:43:19.572479 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:19.572453    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"]
Oct 30 21:43:19.582747 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:19.582724    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-76f77b8948-sl4mt"]
Oct 30 21:43:21.160702 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:21.160669    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9873d8dc-13aa-4168-892f-e0ed30fafdbc" path="/var/lib/kubelet/pods/9873d8dc-13aa-4168-892f-e0ed30fafdbc/volumes"
Oct 30 21:43:24.201645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:24.201606    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:43:34.201469 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:34.201427    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:43:44.201244 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:44.201211    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:43:45.670436 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:43:45.670401    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:43:47.905338 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:47.905306    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"]
Oct 30 21:43:47.905829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:47.905700    5937 cpu_manager.go:414] "containerMap: removing container" podUID="9873d8dc-13aa-4168-892f-e0ed30fafdbc" containerName="ta-container"
Oct 30 21:43:47.905829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:47.905713    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9873d8dc-13aa-4168-892f-e0ed30fafdbc" containerName="ta-container"
Oct 30 21:43:47.905829 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:47.905795    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="9873d8dc-13aa-4168-892f-e0ed30fafdbc" containerName="ta-container"
Oct 30 21:43:47.908976 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:47.908961    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:47.925233 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:47.925209    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ad38deec-587d-485a-9f4a-c2e927dc0ab5-ta-internal\") pod \"data-science-collector-targetallocator-6c5cd7b6-g2sg2\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:47.925338 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:47.925247    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2rvq\" (UniqueName: \"kubernetes.io/projected/ad38deec-587d-485a-9f4a-c2e927dc0ab5-kube-api-access-j2rvq\") pod \"data-science-collector-targetallocator-6c5cd7b6-g2sg2\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:47.925338 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:47.925273    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ad38deec-587d-485a-9f4a-c2e927dc0ab5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c5cd7b6-g2sg2\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:47.970215 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:47.970186    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"]
Oct 30 21:43:48.026587 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.026558    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ad38deec-587d-485a-9f4a-c2e927dc0ab5-ta-internal\") pod \"data-science-collector-targetallocator-6c5cd7b6-g2sg2\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:48.026747 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.026601    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2rvq\" (UniqueName: \"kubernetes.io/projected/ad38deec-587d-485a-9f4a-c2e927dc0ab5-kube-api-access-j2rvq\") pod \"data-science-collector-targetallocator-6c5cd7b6-g2sg2\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:48.026747 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.026639    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ad38deec-587d-485a-9f4a-c2e927dc0ab5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c5cd7b6-g2sg2\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:48.027171 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.027138    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ad38deec-587d-485a-9f4a-c2e927dc0ab5-ta-internal\") pod \"data-science-collector-targetallocator-6c5cd7b6-g2sg2\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:48.029233 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.029212    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ad38deec-587d-485a-9f4a-c2e927dc0ab5-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c5cd7b6-g2sg2\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:48.089519 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.089496    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2rvq\" (UniqueName: \"kubernetes.io/projected/ad38deec-587d-485a-9f4a-c2e927dc0ab5-kube-api-access-j2rvq\") pod \"data-science-collector-targetallocator-6c5cd7b6-g2sg2\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:48.220272 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.220247    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:48.591668 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.591509    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"]
Oct 30 21:43:48.594066 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:43:48.594027    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad38deec_587d_485a_9f4a_c2e927dc0ab5.slice/crio-a9c9b9291110148cd5227546dcc7c8b514816df5d094960591479caad965bf4d WatchSource:0}: Error finding container a9c9b9291110148cd5227546dcc7c8b514816df5d094960591479caad965bf4d: Status 404 returned error can't find the container with id a9c9b9291110148cd5227546dcc7c8b514816df5d094960591479caad965bf4d
Oct 30 21:43:48.596112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.596082    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:43:48.596195 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:48.596137    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:43:49.522501 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:49.522465    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2" event={"ID":"ad38deec-587d-485a-9f4a-c2e927dc0ab5","Type":"ContainerStarted","Data":"9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d"}
Oct 30 21:43:49.522501 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:49.522507    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2" event={"ID":"ad38deec-587d-485a-9f4a-c2e927dc0ab5","Type":"ContainerStarted","Data":"a9c9b9291110148cd5227546dcc7c8b514816df5d094960591479caad965bf4d"}
Oct 30 21:43:49.522977 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:49.522680    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:49.523833 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:49.523811    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2" podUID="ad38deec-587d-485a-9f4a-c2e927dc0ab5" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.159:8080/readyz\": dial tcp 10.134.0.159:8080: connect: connection refused"
Oct 30 21:43:49.642991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:49.642944    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2" podStartSLOduration=2.642930612 podStartE2EDuration="2.642930612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:49.642703303 +0000 UTC m=+4004.598718081" watchObservedRunningTime="2026-10-30 21:43:49.642930612 +0000 UTC m=+4004.598945389"
Oct 30 21:43:50.527428 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:50.527402    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:43:50.697500 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:50.697470    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"]
Oct 30 21:43:50.697720 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:50.697696    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m" podUID="9eb851c5-b0eb-432c-b651-ad991a5d48a2" containerName="ta-container" containerID="cri-o://b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30" gracePeriod=30
Oct 30 21:43:50.978816 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:50.978787    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:51.051752 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.051723    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9eb851c5-b0eb-432c-b651-ad991a5d48a2-ta-internal\" (UniqueName: \"kubernetes.io/configmap/9eb851c5-b0eb-432c-b651-ad991a5d48a2-ta-internal\") pod \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") "
Oct 30 21:43:51.051914 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.051816    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9eb851c5-b0eb-432c-b651-ad991a5d48a2-kube-api-access-qssl8\" (UniqueName: \"kubernetes.io/projected/9eb851c5-b0eb-432c-b651-ad991a5d48a2-kube-api-access-qssl8\") pod \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") "
Oct 30 21:43:51.051914 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.051883    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9eb851c5-b0eb-432c-b651-ad991a5d48a2-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9eb851c5-b0eb-432c-b651-ad991a5d48a2-data-science-collector-ta-server-cert\") pod \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\" (UID: \"9eb851c5-b0eb-432c-b651-ad991a5d48a2\") "
Oct 30 21:43:51.052081 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.052057    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eb851c5-b0eb-432c-b651-ad991a5d48a2-ta-internal" pod "9eb851c5-b0eb-432c-b651-ad991a5d48a2" (UID: "9eb851c5-b0eb-432c-b651-ad991a5d48a2"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:43:51.052142 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.052128    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/9eb851c5-b0eb-432c-b651-ad991a5d48a2-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:51.054082 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.054050    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9eb851c5-b0eb-432c-b651-ad991a5d48a2-data-science-collector-ta-server-cert" pod "9eb851c5-b0eb-432c-b651-ad991a5d48a2" (UID: "9eb851c5-b0eb-432c-b651-ad991a5d48a2"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:43:51.054188 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.054170    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eb851c5-b0eb-432c-b651-ad991a5d48a2-kube-api-access-qssl8" pod "9eb851c5-b0eb-432c-b651-ad991a5d48a2" (UID: "9eb851c5-b0eb-432c-b651-ad991a5d48a2"). InnerVolumeSpecName "kube-api-access-qssl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:43:51.153013 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.152980    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qssl8\" (UniqueName: \"kubernetes.io/projected/9eb851c5-b0eb-432c-b651-ad991a5d48a2-kube-api-access-qssl8\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:51.153013 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.153010    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/9eb851c5-b0eb-432c-b651-ad991a5d48a2-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:43:51.533347 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.533312    5937 generic.go:356] "Generic (PLEG): container finished" podID="9eb851c5-b0eb-432c-b651-ad991a5d48a2" containerID="b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30" exitCode=0
Oct 30 21:43:51.533859 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.533355    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"
Oct 30 21:43:51.533859 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.533400    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m" event={"ID":"9eb851c5-b0eb-432c-b651-ad991a5d48a2","Type":"ContainerDied","Data":"b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30"}
Oct 30 21:43:51.533859 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.533450    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m" event={"ID":"9eb851c5-b0eb-432c-b651-ad991a5d48a2","Type":"ContainerDied","Data":"b00e88d4b586a77e31139e4d80c6a59e89c9555102c5ee87a8a427600ece4245"}
Oct 30 21:43:51.533859 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.533470    5937 scope.go:122] "RemoveContainer" containerID="b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30"
Oct 30 21:43:51.542288 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.542272    5937 scope.go:122] "RemoveContainer" containerID="b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30"
Oct 30 21:43:51.542562 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:43:51.542525    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30\": container with ID starting with b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30 not found: ID does not exist" containerID="b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30"
Oct 30 21:43:51.542645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.542570    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30"} err="failed to get container status \"b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30\": rpc error: code = NotFound desc = could not find container \"b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30\": container with ID starting with b6043c89992961173e968b83943abd1d7c421d5c6610de053acb27f63238fb30 not found: ID does not exist"
Oct 30 21:43:51.704396 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.704363    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"]
Oct 30 21:43:51.708433 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:51.708410    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5545cdb985-9tz4m"]
Oct 30 21:43:53.160994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:53.160960    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9eb851c5-b0eb-432c-b651-ad991a5d48a2" path="/var/lib/kubelet/pods/9eb851c5-b0eb-432c-b651-ad991a5d48a2/volumes"
Oct 30 21:43:54.201629 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:43:54.201594    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:44:04.201517 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:04.201448    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:44:08.619854 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:08.619821    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"]
Oct 30 21:44:08.620670 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:08.620616    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2" podUID="ad38deec-587d-485a-9f4a-c2e927dc0ab5" containerName="ta-container" containerID="cri-o://9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d" gracePeriod=30
Oct 30 21:44:08.930652 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:08.930626    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:44:08.962606 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:08.962579    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:44:08.962787 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:08.962766    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="f7ce75ae-e92f-4796-9500-b356c44a0685" containerName="perses" containerID="cri-o://da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235" gracePeriod=30
Oct 30 21:44:09.012391 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.012364    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad38deec-587d-485a-9f4a-c2e927dc0ab5-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ad38deec-587d-485a-9f4a-c2e927dc0ab5-data-science-collector-ta-server-cert\") pod \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") "
Oct 30 21:44:09.012501 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.012400    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad38deec-587d-485a-9f4a-c2e927dc0ab5-ta-internal\" (UniqueName: \"kubernetes.io/configmap/ad38deec-587d-485a-9f4a-c2e927dc0ab5-ta-internal\") pod \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") "
Oct 30 21:44:09.012501 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.012481    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad38deec-587d-485a-9f4a-c2e927dc0ab5-kube-api-access-j2rvq\" (UniqueName: \"kubernetes.io/projected/ad38deec-587d-485a-9f4a-c2e927dc0ab5-kube-api-access-j2rvq\") pod \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\" (UID: \"ad38deec-587d-485a-9f4a-c2e927dc0ab5\") "
Oct 30 21:44:09.012841 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.012817    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad38deec-587d-485a-9f4a-c2e927dc0ab5-ta-internal" pod "ad38deec-587d-485a-9f4a-c2e927dc0ab5" (UID: "ad38deec-587d-485a-9f4a-c2e927dc0ab5"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:09.014451 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.014429    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad38deec-587d-485a-9f4a-c2e927dc0ab5-data-science-collector-ta-server-cert" pod "ad38deec-587d-485a-9f4a-c2e927dc0ab5" (UID: "ad38deec-587d-485a-9f4a-c2e927dc0ab5"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:44:09.014577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.014553    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad38deec-587d-485a-9f4a-c2e927dc0ab5-kube-api-access-j2rvq" pod "ad38deec-587d-485a-9f4a-c2e927dc0ab5" (UID: "ad38deec-587d-485a-9f4a-c2e927dc0ab5"). InnerVolumeSpecName "kube-api-access-j2rvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:09.113444 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.113413    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2rvq\" (UniqueName: \"kubernetes.io/projected/ad38deec-587d-485a-9f4a-c2e927dc0ab5-kube-api-access-j2rvq\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:09.113444 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.113444    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/ad38deec-587d-485a-9f4a-c2e927dc0ab5-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:09.113663 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.113459    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/ad38deec-587d-485a-9f4a-c2e927dc0ab5-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:09.232121 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.232098    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:09.315299 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.315272    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f7ce75ae-e92f-4796-9500-b356c44a0685-config\" (UniqueName: \"kubernetes.io/configmap/f7ce75ae-e92f-4796-9500-b356c44a0685-config\") pod \"f7ce75ae-e92f-4796-9500-b356c44a0685\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") "
Oct 30 21:44:09.315471 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.315318    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f7ce75ae-e92f-4796-9500-b356c44a0685-kube-api-access-4snkw\" (UniqueName: \"kubernetes.io/projected/f7ce75ae-e92f-4796-9500-b356c44a0685-kube-api-access-4snkw\") pod \"f7ce75ae-e92f-4796-9500-b356c44a0685\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") "
Oct 30 21:44:09.315471 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.315378    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f7ce75ae-e92f-4796-9500-b356c44a0685-plugins\" (UniqueName: \"kubernetes.io/empty-dir/f7ce75ae-e92f-4796-9500-b356c44a0685-plugins\") pod \"f7ce75ae-e92f-4796-9500-b356c44a0685\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") "
Oct 30 21:44:09.315630 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.315568    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"f7ce75ae-e92f-4796-9500-b356c44a0685\" (UID: \"f7ce75ae-e92f-4796-9500-b356c44a0685\") "
Oct 30 21:44:09.315725 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.315612    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7ce75ae-e92f-4796-9500-b356c44a0685-config" pod "f7ce75ae-e92f-4796-9500-b356c44a0685" (UID: "f7ce75ae-e92f-4796-9500-b356c44a0685"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:44:09.315867 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.315851    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ce75ae-e92f-4796-9500-b356c44a0685-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:09.317476 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.317448    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7ce75ae-e92f-4796-9500-b356c44a0685-kube-api-access-4snkw" pod "f7ce75ae-e92f-4796-9500-b356c44a0685" (UID: "f7ce75ae-e92f-4796-9500-b356c44a0685"). InnerVolumeSpecName "kube-api-access-4snkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:09.318138 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.318119    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "f7ce75ae-e92f-4796-9500-b356c44a0685" (UID: "f7ce75ae-e92f-4796-9500-b356c44a0685"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:44:09.417216 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.417189    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4snkw\" (UniqueName: \"kubernetes.io/projected/f7ce75ae-e92f-4796-9500-b356c44a0685-kube-api-access-4snkw\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:09.417339 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.417230    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:44:09.430184 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.430164    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:44:09.461784 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.461753    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7ce75ae-e92f-4796-9500-b356c44a0685-plugins" pod "f7ce75ae-e92f-4796-9500-b356c44a0685" (UID: "f7ce75ae-e92f-4796-9500-b356c44a0685"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:44:09.517784 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.517755    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:44:09.517784 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.517782    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/f7ce75ae-e92f-4796-9500-b356c44a0685-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:09.619664 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.619633    5937 generic.go:356] "Generic (PLEG): container finished" podID="f7ce75ae-e92f-4796-9500-b356c44a0685" containerID="da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235" exitCode=0
Oct 30 21:44:09.619825 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.619682    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:09.619825 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.619709    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f7ce75ae-e92f-4796-9500-b356c44a0685","Type":"ContainerDied","Data":"da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235"}
Oct 30 21:44:09.619825 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.619746    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"f7ce75ae-e92f-4796-9500-b356c44a0685","Type":"ContainerDied","Data":"bc4b92de77717e5223ac5c95e0700385b1f84b4d6206a69da869c7d760e1f2a8"}
Oct 30 21:44:09.619825 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.619766    5937 scope.go:122] "RemoveContainer" containerID="da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235"
Oct 30 21:44:09.621112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.621087    5937 generic.go:356] "Generic (PLEG): container finished" podID="ad38deec-587d-485a-9f4a-c2e927dc0ab5" containerID="9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d" exitCode=0
Oct 30 21:44:09.621194 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.621131    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"
Oct 30 21:44:09.621194 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.621176    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2" event={"ID":"ad38deec-587d-485a-9f4a-c2e927dc0ab5","Type":"ContainerDied","Data":"9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d"}
Oct 30 21:44:09.621298 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.621210    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2" event={"ID":"ad38deec-587d-485a-9f4a-c2e927dc0ab5","Type":"ContainerDied","Data":"a9c9b9291110148cd5227546dcc7c8b514816df5d094960591479caad965bf4d"}
Oct 30 21:44:09.628882 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.628721    5937 scope.go:122] "RemoveContainer" containerID="da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235"
Oct 30 21:44:09.629001 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:44:09.628982    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235\": container with ID starting with da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235 not found: ID does not exist" containerID="da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235"
Oct 30 21:44:09.629066 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.629010    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235"} err="failed to get container status \"da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235\": rpc error: code = NotFound desc = could not find container \"da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235\": container with ID starting with da8c47fbb001cd0ed7b986e472c3d10f423245056dfeabbcdc59090a10a7e235 not found: ID does not exist"
Oct 30 21:44:09.629066 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.629032    5937 scope.go:122] "RemoveContainer" containerID="9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d"
Oct 30 21:44:09.636292 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.636274    5937 scope.go:122] "RemoveContainer" containerID="9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d"
Oct 30 21:44:09.636530 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:44:09.636515    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d\": container with ID starting with 9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d not found: ID does not exist" containerID="9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d"
Oct 30 21:44:09.636530 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.636593    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d"} err="failed to get container status \"9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d\": rpc error: code = NotFound desc = could not find container \"9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d\": container with ID starting with 9337105f1fede5d9d8c3b010e71d5b9f00216afb9b013eccc15323aeb233706d not found: ID does not exist"
Oct 30 21:44:09.795742 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.795709    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"]
Oct 30 21:44:09.846455 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.846434    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c5cd7b6-g2sg2"]
Oct 30 21:44:09.919175 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.919153    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:44:09.924113 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:09.924091    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:44:11.160667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:11.160628    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad38deec-587d-485a-9f4a-c2e927dc0ab5" path="/var/lib/kubelet/pods/ad38deec-587d-485a-9f4a-c2e927dc0ab5/volumes"
Oct 30 21:44:11.161196 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:11.161177    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f7ce75ae-e92f-4796-9500-b356c44a0685" path="/var/lib/kubelet/pods/f7ce75ae-e92f-4796-9500-b356c44a0685/volumes"
Oct 30 21:44:14.201722 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:14.201685    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:44:15.671768 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:44:15.671731    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:44:24.200896 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:24.200860    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:44:28.340484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.340453    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"]
Oct 30 21:44:28.340955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.340880    5937 cpu_manager.go:414] "containerMap: removing container" podUID="f7ce75ae-e92f-4796-9500-b356c44a0685" containerName="perses"
Oct 30 21:44:28.340955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.340894    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f7ce75ae-e92f-4796-9500-b356c44a0685" containerName="perses"
Oct 30 21:44:28.340955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.340906    5937 cpu_manager.go:414] "containerMap: removing container" podUID="9eb851c5-b0eb-432c-b651-ad991a5d48a2" containerName="ta-container"
Oct 30 21:44:28.340955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.340912    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9eb851c5-b0eb-432c-b651-ad991a5d48a2" containerName="ta-container"
Oct 30 21:44:28.340955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.340928    5937 cpu_manager.go:414] "containerMap: removing container" podUID="ad38deec-587d-485a-9f4a-c2e927dc0ab5" containerName="ta-container"
Oct 30 21:44:28.340955 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.340934    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad38deec-587d-485a-9f4a-c2e927dc0ab5" containerName="ta-container"
Oct 30 21:44:28.341155 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.340998    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad38deec-587d-485a-9f4a-c2e927dc0ab5" containerName="ta-container"
Oct 30 21:44:28.341155 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.341009    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="f7ce75ae-e92f-4796-9500-b356c44a0685" containerName="perses"
Oct 30 21:44:28.341155 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.341016    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="9eb851c5-b0eb-432c-b651-ad991a5d48a2" containerName="ta-container"
Oct 30 21:44:28.345190 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.345164    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"
Oct 30 21:44:28.408085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.408054    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"]
Oct 30 21:44:28.456723 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.456700    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:44:28.481858 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.481829    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mctqr\" (UniqueName: \"kubernetes.io/projected/c5be522e-1b5e-4ff0-a9b6-54a5c13782c7-kube-api-access-mctqr\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb\" (UID: \"c5be522e-1b5e-4ff0-a9b6-54a5c13782c7\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"
Oct 30 21:44:28.583112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.583086    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mctqr\" (UniqueName: \"kubernetes.io/projected/c5be522e-1b5e-4ff0-a9b6-54a5c13782c7-kube-api-access-mctqr\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb\" (UID: \"c5be522e-1b5e-4ff0-a9b6-54a5c13782c7\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"
Oct 30 21:44:28.646060 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.645995    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mctqr\" (UniqueName: \"kubernetes.io/projected/c5be522e-1b5e-4ff0-a9b6-54a5c13782c7-kube-api-access-mctqr\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb\" (UID: \"c5be522e-1b5e-4ff0-a9b6-54a5c13782c7\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"
Oct 30 21:44:28.656785 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:28.656765    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"
Oct 30 21:44:29.031087 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:29.029023    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"]
Oct 30 21:44:29.707162 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:29.707130    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb" event={"ID":"c5be522e-1b5e-4ff0-a9b6-54a5c13782c7","Type":"ContainerStarted","Data":"1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281"}
Oct 30 21:44:29.707162 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:29.707168    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb" event={"ID":"c5be522e-1b5e-4ff0-a9b6-54a5c13782c7","Type":"ContainerStarted","Data":"e4b25ea14898596a90cef4fd5e5104db8ab4bfe48c4fe560c895cc9768308f0e"}
Oct 30 21:44:29.832646 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:29.832594    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb" podStartSLOduration=1.832580377 podStartE2EDuration="1.832580377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:29.832039125 +0000 UTC m=+4044.788053901" watchObservedRunningTime="2026-10-30 21:44:29.832580377 +0000 UTC m=+4044.788595153"
Oct 30 21:44:31.727835 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.727803    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:44:31.731237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.731221    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:31.790395 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.790371    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:44:31.841402 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.841380    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:44:31.911455 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.911428    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"]
Oct 30 21:44:31.914675 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.914657    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:31.969898 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.969879    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:44:31.970020 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.969949    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-4bqdz\""
Oct 30 21:44:31.970234 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.970218    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:44:31.976138 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:31.976117    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"]
Oct 30 21:44:32.013989 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.013936    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw76v\" (UniqueName: \"kubernetes.io/projected/2f5019ef-075e-4a08-b644-b8a9195e2b93-kube-api-access-fw76v\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:32.013989 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.013971    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f5019ef-075e-4a08-b644-b8a9195e2b93-config\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:32.014160 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.014071    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/2f5019ef-075e-4a08-b644-b8a9195e2b93-plugins\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:32.115359 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.115327    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw76v\" (UniqueName: \"kubernetes.io/projected/2f5019ef-075e-4a08-b644-b8a9195e2b93-kube-api-access-fw76v\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:32.115570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.115370    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f5019ef-075e-4a08-b644-b8a9195e2b93-config\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:32.115570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.115401    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6zw\" (UniqueName: \"kubernetes.io/projected/42c07f5e-f5cc-4d25-b61c-c081958d171f-kube-api-access-qz6zw\") pod \"data-science-collector-targetallocator-5656b7c54d-2c22p\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.115570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.115424    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/42c07f5e-f5cc-4d25-b61c-c081958d171f-ta-internal\") pod \"data-science-collector-targetallocator-5656b7c54d-2c22p\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.115570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.115455    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/2f5019ef-075e-4a08-b644-b8a9195e2b93-plugins\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:32.115570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.115481    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/42c07f5e-f5cc-4d25-b61c-c081958d171f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5656b7c54d-2c22p\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.115892 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.115871    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/2f5019ef-075e-4a08-b644-b8a9195e2b93-plugins\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:32.116115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.116099    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f5019ef-075e-4a08-b644-b8a9195e2b93-config\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:32.179459 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.179420    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw76v\" (UniqueName: \"kubernetes.io/projected/2f5019ef-075e-4a08-b644-b8a9195e2b93-kube-api-access-fw76v\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:32.216107 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.216067    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/42c07f5e-f5cc-4d25-b61c-c081958d171f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5656b7c54d-2c22p\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.216283 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.216188    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6zw\" (UniqueName: \"kubernetes.io/projected/42c07f5e-f5cc-4d25-b61c-c081958d171f-kube-api-access-qz6zw\") pod \"data-science-collector-targetallocator-5656b7c54d-2c22p\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.216283 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.216222    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/42c07f5e-f5cc-4d25-b61c-c081958d171f-ta-internal\") pod \"data-science-collector-targetallocator-5656b7c54d-2c22p\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.216964 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.216942    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/42c07f5e-f5cc-4d25-b61c-c081958d171f-ta-internal\") pod \"data-science-collector-targetallocator-5656b7c54d-2c22p\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.219092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.219060    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/42c07f5e-f5cc-4d25-b61c-c081958d171f-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-5656b7c54d-2c22p\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.299774 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.299709    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6zw\" (UniqueName: \"kubernetes.io/projected/42c07f5e-f5cc-4d25-b61c-c081958d171f-kube-api-access-qz6zw\") pod \"data-science-collector-targetallocator-5656b7c54d-2c22p\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.526042 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.526013    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:32.906512 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.906443    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"]
Oct 30 21:44:32.909523 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:44:32.909491    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42c07f5e_f5cc_4d25_b61c_c081958d171f.slice/crio-7857a94b7a568b410a270f5635161467b8012e2a7552ffc0bfa289bd8b750ebe WatchSource:0}: Error finding container 7857a94b7a568b410a270f5635161467b8012e2a7552ffc0bfa289bd8b750ebe: Status 404 returned error can't find the container with id 7857a94b7a568b410a270f5635161467b8012e2a7552ffc0bfa289bd8b750ebe
Oct 30 21:44:32.911730 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.911698    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:44:32.911818 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:32.911758    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:44:33.725352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:33.725317    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p" event={"ID":"42c07f5e-f5cc-4d25-b61c-c081958d171f","Type":"ContainerStarted","Data":"5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b"}
Oct 30 21:44:33.725570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:33.725359    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p" event={"ID":"42c07f5e-f5cc-4d25-b61c-c081958d171f","Type":"ContainerStarted","Data":"7857a94b7a568b410a270f5635161467b8012e2a7552ffc0bfa289bd8b750ebe"}
Oct 30 21:44:33.725570 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:33.725512    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:33.726692 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:33.726666    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p" podUID="42c07f5e-f5cc-4d25-b61c-c081958d171f" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.162:8080/readyz\": dial tcp 10.134.0.162:8080: connect: connection refused"
Oct 30 21:44:33.847129 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:33.847069    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p" podStartSLOduration=2.847052222 podStartE2EDuration="2.847052222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:33.846191894 +0000 UTC m=+4048.802206684" watchObservedRunningTime="2026-10-30 21:44:33.847052222 +0000 UTC m=+4048.803066999"
Oct 30 21:44:34.132131 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.132056    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:34.201164 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.201122    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:44:34.247434 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.247402    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:34.333935 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.333907    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:34.334092 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.334004    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:34.387367 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.387309    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:34.527792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.527754    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:34.598708 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.598677    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:34.730726 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.730700    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:44:34.743000 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:34.742974    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:35.126045 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:35.126025    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:44:35.128119 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:44:35.128090    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f5019ef_075e_4a08_b644_b8a9195e2b93.slice/crio-5b062b2759d34a395303497ca82c3f70c4f0a05bdc112d6418960051e2801d11 WatchSource:0}: Error finding container 5b062b2759d34a395303497ca82c3f70c4f0a05bdc112d6418960051e2801d11: Status 404 returned error can't find the container with id 5b062b2759d34a395303497ca82c3f70c4f0a05bdc112d6418960051e2801d11
Oct 30 21:44:35.735602 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:35.735561    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"2f5019ef-075e-4a08-b644-b8a9195e2b93","Type":"ContainerStarted","Data":"5679429feac16c6fab236fa662800dd3e165a813b5d1e106da6b7d4131911438"}
Oct 30 21:44:35.736013 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:35.735613    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"2f5019ef-075e-4a08-b644-b8a9195e2b93","Type":"ContainerStarted","Data":"5b062b2759d34a395303497ca82c3f70c4f0a05bdc112d6418960051e2801d11"}
Oct 30 21:44:35.862124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:35.862066    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=4.862054117 podStartE2EDuration="4.862054117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:35.861814417 +0000 UTC m=+4050.817829193" watchObservedRunningTime="2026-10-30 21:44:35.862054117 +0000 UTC m=+4050.818068893"
Oct 30 21:44:36.740555 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:36.740505    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:44.201518 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:44.201467    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:44:44.233720 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:44.233686    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"]
Oct 30 21:44:44.239289 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:44.239266    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"
Oct 30 21:44:44.279181 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:44.278947    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"]
Oct 30 21:44:44.320076 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:44.320038    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpqsv\" (UniqueName: \"kubernetes.io/projected/3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd-kube-api-access-zpqsv\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj\" (UID: \"3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"
Oct 30 21:44:44.421145 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:44.421114    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpqsv\" (UniqueName: \"kubernetes.io/projected/3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd-kube-api-access-zpqsv\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj\" (UID: \"3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"
Oct 30 21:44:44.490030 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:44.489997    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpqsv\" (UniqueName: \"kubernetes.io/projected/3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd-kube-api-access-zpqsv\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj\" (UID: \"3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"
Oct 30 21:44:44.552464 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:44.552436    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"
Oct 30 21:44:44.932782 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:44.932760    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"]
Oct 30 21:44:44.934620 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:44:44.934592    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cd868a4_ff37_4c22_a3c5_a03bcc3c3ccd.slice/crio-142a3c552476bc308aacb9a55b99fa0af01d540b3f46af8534120aec9c86cee0 WatchSource:0}: Error finding container 142a3c552476bc308aacb9a55b99fa0af01d540b3f46af8534120aec9c86cee0: Status 404 returned error can't find the container with id 142a3c552476bc308aacb9a55b99fa0af01d540b3f46af8534120aec9c86cee0
Oct 30 21:44:45.671100 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:44:45.671062    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:44:45.781422 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:45.781389    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj" event={"ID":"3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd","Type":"ContainerStarted","Data":"f90469a634ffa6289de0f601cd28cbc62e83e155297c1277af95e8ad57994140"}
Oct 30 21:44:45.781422 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:45.781429    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj" event={"ID":"3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd","Type":"ContainerStarted","Data":"142a3c552476bc308aacb9a55b99fa0af01d540b3f46af8534120aec9c86cee0"}
Oct 30 21:44:45.910047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:45.909996    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj" podStartSLOduration=1.909983668 podStartE2EDuration="1.909983668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:45.908798218 +0000 UTC m=+4060.864812994" watchObservedRunningTime="2026-10-30 21:44:45.909983668 +0000 UTC m=+4060.865998444"
Oct 30 21:44:45.960374 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:45.960347    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"]
Oct 30 21:44:45.960618 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:45.960593    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb" podUID="c5be522e-1b5e-4ff0-a9b6-54a5c13782c7" containerName="thanos-querier" containerID="cri-o://1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281" gracePeriod=30
Oct 30 21:44:46.238881 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.238854    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"
Oct 30 21:44:46.339734 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.339706    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5be522e-1b5e-4ff0-a9b6-54a5c13782c7-kube-api-access-mctqr\" (UniqueName: \"kubernetes.io/projected/c5be522e-1b5e-4ff0-a9b6-54a5c13782c7-kube-api-access-mctqr\") pod \"c5be522e-1b5e-4ff0-a9b6-54a5c13782c7\" (UID: \"c5be522e-1b5e-4ff0-a9b6-54a5c13782c7\") "
Oct 30 21:44:46.342023 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.341996    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5be522e-1b5e-4ff0-a9b6-54a5c13782c7-kube-api-access-mctqr" pod "c5be522e-1b5e-4ff0-a9b6-54a5c13782c7" (UID: "c5be522e-1b5e-4ff0-a9b6-54a5c13782c7"). InnerVolumeSpecName "kube-api-access-mctqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:44:46.441099 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.441073    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mctqr\" (UniqueName: \"kubernetes.io/projected/c5be522e-1b5e-4ff0-a9b6-54a5c13782c7-kube-api-access-mctqr\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:44:46.787390 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.787356    5937 generic.go:356] "Generic (PLEG): container finished" podID="c5be522e-1b5e-4ff0-a9b6-54a5c13782c7" containerID="1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281" exitCode=0
Oct 30 21:44:46.787810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.787403    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"
Oct 30 21:44:46.787810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.787442    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb" event={"ID":"c5be522e-1b5e-4ff0-a9b6-54a5c13782c7","Type":"ContainerDied","Data":"1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281"}
Oct 30 21:44:46.787810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.787487    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb" event={"ID":"c5be522e-1b5e-4ff0-a9b6-54a5c13782c7","Type":"ContainerDied","Data":"e4b25ea14898596a90cef4fd5e5104db8ab4bfe48c4fe560c895cc9768308f0e"}
Oct 30 21:44:46.787810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.787514    5937 scope.go:122] "RemoveContainer" containerID="1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281"
Oct 30 21:44:46.796414 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.796397    5937 scope.go:122] "RemoveContainer" containerID="1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281"
Oct 30 21:44:46.796714 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:44:46.796695    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281\": container with ID starting with 1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281 not found: ID does not exist" containerID="1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281"
Oct 30 21:44:46.796787 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.796727    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281"} err="failed to get container status \"1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281\": rpc error: code = NotFound desc = could not find container \"1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281\": container with ID starting with 1ae37af36eb1044f54a5cd8a0e7ce2d4a622670b56bc1a4aa71c9cfb18578281 not found: ID does not exist"
Oct 30 21:44:46.953902 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:46.953876    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"]
Oct 30 21:44:47.004688 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:47.004651    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-swtvb"]
Oct 30 21:44:47.160991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:47.160903    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5be522e-1b5e-4ff0-a9b6-54a5c13782c7" path="/var/lib/kubelet/pods/c5be522e-1b5e-4ff0-a9b6-54a5c13782c7/volumes"
Oct 30 21:44:47.747723 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:47.747695    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:44:54.201974 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:44:54.201941    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:45:04.201810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:04.201775    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:45:14.201153 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:14.201119    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:45:15.671914 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:45:15.671879    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:45:18.842646 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:18.842615    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"]
Oct 30 21:45:18.843086 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:18.843050    5937 cpu_manager.go:414] "containerMap: removing container" podUID="c5be522e-1b5e-4ff0-a9b6-54a5c13782c7" containerName="thanos-querier"
Oct 30 21:45:18.843086 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:18.843068    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5be522e-1b5e-4ff0-a9b6-54a5c13782c7" containerName="thanos-querier"
Oct 30 21:45:18.843173 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:18.843163    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5be522e-1b5e-4ff0-a9b6-54a5c13782c7" containerName="thanos-querier"
Oct 30 21:45:18.846118 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:18.846104    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:18.910655 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:18.910623    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"]
Oct 30 21:45:18.914954 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:18.914931    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-ta-internal\") pod \"data-science-collector-targetallocator-6b8fc4945c-t8f85\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:18.915090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:18.915025    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28rb8\" (UniqueName: \"kubernetes.io/projected/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-kube-api-access-28rb8\") pod \"data-science-collector-targetallocator-6b8fc4945c-t8f85\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:18.915090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:18.915061    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b8fc4945c-t8f85\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:19.016527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.016496    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28rb8\" (UniqueName: \"kubernetes.io/projected/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-kube-api-access-28rb8\") pod \"data-science-collector-targetallocator-6b8fc4945c-t8f85\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:19.016704 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.016532    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b8fc4945c-t8f85\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:19.016704 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.016660    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-ta-internal\") pod \"data-science-collector-targetallocator-6b8fc4945c-t8f85\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:19.017251 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.017231    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-ta-internal\") pod \"data-science-collector-targetallocator-6b8fc4945c-t8f85\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:19.019164 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.019145    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6b8fc4945c-t8f85\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:19.079460 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.079433    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28rb8\" (UniqueName: \"kubernetes.io/projected/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-kube-api-access-28rb8\") pod \"data-science-collector-targetallocator-6b8fc4945c-t8f85\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:19.157322 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.157258    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:19.533716 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.533682    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"]
Oct 30 21:45:19.536424 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:45:19.536395    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9eab2b6_9a75_4978_96a4_ad931f5bf77c.slice/crio-752bcc56a93e45066ff8439a646bd825d5f60afe239ba6b2f94e62fd232f84e6 WatchSource:0}: Error finding container 752bcc56a93e45066ff8439a646bd825d5f60afe239ba6b2f94e62fd232f84e6: Status 404 returned error can't find the container with id 752bcc56a93e45066ff8439a646bd825d5f60afe239ba6b2f94e62fd232f84e6
Oct 30 21:45:19.538684 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.538656    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:19.538761 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.538709    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:19.933778 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.933693    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85" event={"ID":"a9eab2b6-9a75-4978-96a4-ad931f5bf77c","Type":"ContainerStarted","Data":"f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da"}
Oct 30 21:45:19.933778 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.933740    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85" event={"ID":"a9eab2b6-9a75-4978-96a4-ad931f5bf77c","Type":"ContainerStarted","Data":"752bcc56a93e45066ff8439a646bd825d5f60afe239ba6b2f94e62fd232f84e6"}
Oct 30 21:45:19.934209 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.933890    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:19.935046 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:19.935022    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85" podUID="a9eab2b6-9a75-4978-96a4-ad931f5bf77c" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.164:8080/readyz\": dial tcp 10.134.0.164:8080: connect: connection refused"
Oct 30 21:45:20.058072 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:20.058027    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85" podStartSLOduration=2.058014256 podStartE2EDuration="2.058014256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:20.056922037 +0000 UTC m=+4095.012936812" watchObservedRunningTime="2026-10-30 21:45:20.058014256 +0000 UTC m=+4095.014029029"
Oct 30 21:45:20.944277 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:20.944247    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:21.122787 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.122752    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"]
Oct 30 21:45:21.123032 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.123001    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p" podUID="42c07f5e-f5cc-4d25-b61c-c081958d171f" containerName="ta-container" containerID="cri-o://5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b" gracePeriod=30
Oct 30 21:45:21.376843 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.376818    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:45:21.439468 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.439442    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42c07f5e-f5cc-4d25-b61c-c081958d171f-kube-api-access-qz6zw\" (UniqueName: \"kubernetes.io/projected/42c07f5e-f5cc-4d25-b61c-c081958d171f-kube-api-access-qz6zw\") pod \"42c07f5e-f5cc-4d25-b61c-c081958d171f\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") "
Oct 30 21:45:21.439624 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.439496    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/42c07f5e-f5cc-4d25-b61c-c081958d171f-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/42c07f5e-f5cc-4d25-b61c-c081958d171f-data-science-collector-ta-server-cert\") pod \"42c07f5e-f5cc-4d25-b61c-c081958d171f\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") "
Oct 30 21:45:21.439709 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.439645    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42c07f5e-f5cc-4d25-b61c-c081958d171f-ta-internal\" (UniqueName: \"kubernetes.io/configmap/42c07f5e-f5cc-4d25-b61c-c081958d171f-ta-internal\") pod \"42c07f5e-f5cc-4d25-b61c-c081958d171f\" (UID: \"42c07f5e-f5cc-4d25-b61c-c081958d171f\") "
Oct 30 21:45:21.439994 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.439969    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42c07f5e-f5cc-4d25-b61c-c081958d171f-ta-internal" pod "42c07f5e-f5cc-4d25-b61c-c081958d171f" (UID: "42c07f5e-f5cc-4d25-b61c-c081958d171f"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:21.441581 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.441557    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42c07f5e-f5cc-4d25-b61c-c081958d171f-data-science-collector-ta-server-cert" pod "42c07f5e-f5cc-4d25-b61c-c081958d171f" (UID: "42c07f5e-f5cc-4d25-b61c-c081958d171f"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:21.441772 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.441748    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42c07f5e-f5cc-4d25-b61c-c081958d171f-kube-api-access-qz6zw" pod "42c07f5e-f5cc-4d25-b61c-c081958d171f" (UID: "42c07f5e-f5cc-4d25-b61c-c081958d171f"). InnerVolumeSpecName "kube-api-access-qz6zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:21.540766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.540708    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/42c07f5e-f5cc-4d25-b61c-c081958d171f-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:21.540766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.540731    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/42c07f5e-f5cc-4d25-b61c-c081958d171f-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:21.540766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.540741    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz6zw\" (UniqueName: \"kubernetes.io/projected/42c07f5e-f5cc-4d25-b61c-c081958d171f-kube-api-access-qz6zw\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:21.944802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.944720    5937 generic.go:356] "Generic (PLEG): container finished" podID="42c07f5e-f5cc-4d25-b61c-c081958d171f" containerID="5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b" exitCode=0
Oct 30 21:45:21.944802 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.944767    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"
Oct 30 21:45:21.945275 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.944811    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p" event={"ID":"42c07f5e-f5cc-4d25-b61c-c081958d171f","Type":"ContainerDied","Data":"5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b"}
Oct 30 21:45:21.945275 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.944848    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p" event={"ID":"42c07f5e-f5cc-4d25-b61c-c081958d171f","Type":"ContainerDied","Data":"7857a94b7a568b410a270f5635161467b8012e2a7552ffc0bfa289bd8b750ebe"}
Oct 30 21:45:21.945275 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.944873    5937 scope.go:122] "RemoveContainer" containerID="5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b"
Oct 30 21:45:21.953742 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.953652    5937 scope.go:122] "RemoveContainer" containerID="5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b"
Oct 30 21:45:21.953954 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:45:21.953929    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b\": container with ID starting with 5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b not found: ID does not exist" containerID="5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b"
Oct 30 21:45:21.954021 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:21.953955    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b"} err="failed to get container status \"5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b\": rpc error: code = NotFound desc = could not find container \"5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b\": container with ID starting with 5ef8bb08fa86b587e5d789cd744ca4ea9b669ad3c1ba9c7e87c31e3b6c58f85b not found: ID does not exist"
Oct 30 21:45:22.114940 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:22.114908    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"]
Oct 30 21:45:22.165514 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:22.165487    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-5656b7c54d-2c22p"]
Oct 30 21:45:23.161390 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:23.161357    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="42c07f5e-f5cc-4d25-b61c-c081958d171f" path="/var/lib/kubelet/pods/42c07f5e-f5cc-4d25-b61c-c081958d171f/volumes"
Oct 30 21:45:24.201383 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:24.201346    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:45:34.201367 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:34.201328    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:45:44.201489 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:44.201448    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:45:45.669621 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:45:45.669581    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:45:50.742079 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.742036    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"]
Oct 30 21:45:50.742599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.742521    5937 cpu_manager.go:414] "containerMap: removing container" podUID="42c07f5e-f5cc-4d25-b61c-c081958d171f" containerName="ta-container"
Oct 30 21:45:50.742599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.742559    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42c07f5e-f5cc-4d25-b61c-c081958d171f" containerName="ta-container"
Oct 30 21:45:50.742740 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.742698    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="42c07f5e-f5cc-4d25-b61c-c081958d171f" containerName="ta-container"
Oct 30 21:45:50.745622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.745600    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:50.805828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.805790    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"]
Oct 30 21:45:50.884436 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.884402    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d787dcc5c-xmdgw\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:50.884618 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.884585    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjlsq\" (UniqueName: \"kubernetes.io/projected/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-kube-api-access-jjlsq\") pod \"data-science-collector-targetallocator-d787dcc5c-xmdgw\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:50.884677 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.884625    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-ta-internal\") pod \"data-science-collector-targetallocator-d787dcc5c-xmdgw\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:50.985305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.985270    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlsq\" (UniqueName: \"kubernetes.io/projected/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-kube-api-access-jjlsq\") pod \"data-science-collector-targetallocator-d787dcc5c-xmdgw\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:50.985305 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.985309    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-ta-internal\") pod \"data-science-collector-targetallocator-d787dcc5c-xmdgw\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:50.985588 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.985335    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d787dcc5c-xmdgw\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:50.986061 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.985998    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-ta-internal\") pod \"data-science-collector-targetallocator-d787dcc5c-xmdgw\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:50.987945 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:50.987924    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-d787dcc5c-xmdgw\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:51.048318 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:51.048249    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlsq\" (UniqueName: \"kubernetes.io/projected/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-kube-api-access-jjlsq\") pod \"data-science-collector-targetallocator-d787dcc5c-xmdgw\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:51.057147 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:51.057104    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:51.428295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:51.428210    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"]
Oct 30 21:45:51.431492 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:45:51.431469    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod153c6319_43bb_4ee9_a4de_e86dc2dd84e8.slice/crio-8ac87860a8db232b1cf572eec5b07889a98ab357a7811cff9de07e9398f4cc31 WatchSource:0}: Error finding container 8ac87860a8db232b1cf572eec5b07889a98ab357a7811cff9de07e9398f4cc31: Status 404 returned error can't find the container with id 8ac87860a8db232b1cf572eec5b07889a98ab357a7811cff9de07e9398f4cc31
Oct 30 21:45:51.434004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:51.433973    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:51.434112 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:51.434029    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:45:52.079027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:52.078996    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw" event={"ID":"153c6319-43bb-4ee9-a4de-e86dc2dd84e8","Type":"ContainerStarted","Data":"d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35"}
Oct 30 21:45:52.079407 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:52.079036    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw" event={"ID":"153c6319-43bb-4ee9-a4de-e86dc2dd84e8","Type":"ContainerStarted","Data":"8ac87860a8db232b1cf572eec5b07889a98ab357a7811cff9de07e9398f4cc31"}
Oct 30 21:45:52.079407 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:52.079171    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:52.080390 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:52.080366    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw" podUID="153c6319-43bb-4ee9-a4de-e86dc2dd84e8" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.165:8080/readyz\": dial tcp 10.134.0.165:8080: connect: connection refused"
Oct 30 21:45:52.198622 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:52.198574    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw" podStartSLOduration=2.198531683 podStartE2EDuration="2.198531683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:52.197992859 +0000 UTC m=+4127.154007639" watchObservedRunningTime="2026-10-30 21:45:52.198531683 +0000 UTC m=+4127.154546458"
Oct 30 21:45:53.085191 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.085164    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:45:53.260950 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.260923    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"]
Oct 30 21:45:53.261180 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.261151    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85" podUID="a9eab2b6-9a75-4978-96a4-ad931f5bf77c" containerName="ta-container" containerID="cri-o://f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da" gracePeriod=30
Oct 30 21:45:53.517702 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.517676    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:53.610074 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.610042    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-ta-internal\" (UniqueName: \"kubernetes.io/configmap/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-ta-internal\") pod \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") "
Oct 30 21:45:53.610210 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.610193    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-kube-api-access-28rb8\" (UniqueName: \"kubernetes.io/projected/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-kube-api-access-28rb8\") pod \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") "
Oct 30 21:45:53.610293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.610279    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-data-science-collector-ta-server-cert\") pod \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\" (UID: \"a9eab2b6-9a75-4978-96a4-ad931f5bf77c\") "
Oct 30 21:45:53.610367 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.610347    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-ta-internal" pod "a9eab2b6-9a75-4978-96a4-ad931f5bf77c" (UID: "a9eab2b6-9a75-4978-96a4-ad931f5bf77c"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:53.610521 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.610508    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:53.612321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.612298    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-kube-api-access-28rb8" pod "a9eab2b6-9a75-4978-96a4-ad931f5bf77c" (UID: "a9eab2b6-9a75-4978-96a4-ad931f5bf77c"). InnerVolumeSpecName "kube-api-access-28rb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:53.612432 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.612413    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-data-science-collector-ta-server-cert" pod "a9eab2b6-9a75-4978-96a4-ad931f5bf77c" (UID: "a9eab2b6-9a75-4978-96a4-ad931f5bf77c"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:53.711710 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.711685    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28rb8\" (UniqueName: \"kubernetes.io/projected/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-kube-api-access-28rb8\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:53.711710 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:53.711710    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/a9eab2b6-9a75-4978-96a4-ad931f5bf77c-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:54.095497 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.095409    5937 generic.go:356] "Generic (PLEG): container finished" podID="a9eab2b6-9a75-4978-96a4-ad931f5bf77c" containerID="f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da" exitCode=0
Oct 30 21:45:54.095497 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.095462    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"
Oct 30 21:45:54.095497 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.095489    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85" event={"ID":"a9eab2b6-9a75-4978-96a4-ad931f5bf77c","Type":"ContainerDied","Data":"f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da"}
Oct 30 21:45:54.096070 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.095556    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85" event={"ID":"a9eab2b6-9a75-4978-96a4-ad931f5bf77c","Type":"ContainerDied","Data":"752bcc56a93e45066ff8439a646bd825d5f60afe239ba6b2f94e62fd232f84e6"}
Oct 30 21:45:54.096070 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.095574    5937 scope.go:122] "RemoveContainer" containerID="f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da"
Oct 30 21:45:54.104728 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.104713    5937 scope.go:122] "RemoveContainer" containerID="f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da"
Oct 30 21:45:54.104986 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:45:54.104969    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da\": container with ID starting with f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da not found: ID does not exist" containerID="f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da"
Oct 30 21:45:54.105046 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.104993    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da"} err="failed to get container status \"f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da\": rpc error: code = NotFound desc = could not find container \"f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da\": container with ID starting with f1f85fc2ffd3dd1b4ba6528d99f71924c4f27c8627afc8d9d03a45538c1762da not found: ID does not exist"
Oct 30 21:45:54.201243 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.201214    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:45:54.271041 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.271013    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"]
Oct 30 21:45:54.311111 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:54.311085    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6b8fc4945c-t8f85"]
Oct 30 21:45:55.162556 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:45:55.162518    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9eab2b6-9a75-4978-96a4-ad931f5bf77c" path="/var/lib/kubelet/pods/a9eab2b6-9a75-4978-96a4-ad931f5bf77c/volumes"
Oct 30 21:46:04.201469 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:04.201430    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:08.956554 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:08.956431    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"]
Oct 30 21:46:08.956990 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:08.956639    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj" podUID="3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd" containerName="thanos-querier" containerID="cri-o://f90469a634ffa6289de0f601cd28cbc62e83e155297c1277af95e8ad57994140" gracePeriod=30
Oct 30 21:46:09.165312 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:09.165283    5937 generic.go:356] "Generic (PLEG): container finished" podID="3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd" containerID="f90469a634ffa6289de0f601cd28cbc62e83e155297c1277af95e8ad57994140" exitCode=0
Oct 30 21:46:09.165492 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:09.165321    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj" event={"ID":"3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd","Type":"ContainerDied","Data":"f90469a634ffa6289de0f601cd28cbc62e83e155297c1277af95e8ad57994140"}
Oct 30 21:46:09.216115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:09.216065    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"
Oct 30 21:46:09.243692 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:09.243664    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd-kube-api-access-zpqsv\" (UniqueName: \"kubernetes.io/projected/3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd-kube-api-access-zpqsv\") pod \"3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd\" (UID: \"3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd\") "
Oct 30 21:46:09.246590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:09.246562    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd-kube-api-access-zpqsv" pod "3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd" (UID: "3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd"). InnerVolumeSpecName "kube-api-access-zpqsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:09.344659 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:09.344630    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpqsv\" (UniqueName: \"kubernetes.io/projected/3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd-kube-api-access-zpqsv\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.171167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:10.171136    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"
Oct 30 21:46:10.171167 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:10.171162    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj" event={"ID":"3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd","Type":"ContainerDied","Data":"142a3c552476bc308aacb9a55b99fa0af01d540b3f46af8534120aec9c86cee0"}
Oct 30 21:46:10.171644 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:10.171206    5937 scope.go:122] "RemoveContainer" containerID="f90469a634ffa6289de0f601cd28cbc62e83e155297c1277af95e8ad57994140"
Oct 30 21:46:10.336923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:10.336894    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"]
Oct 30 21:46:10.387525 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:10.387493    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r6rvj"]
Oct 30 21:46:11.160661 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.160633    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd" path="/var/lib/kubelet/pods/3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd/volumes"
Oct 30 21:46:11.692595 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.692565    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"]
Oct 30 21:46:11.693090 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.692755    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw" podUID="153c6319-43bb-4ee9-a4de-e86dc2dd84e8" containerName="ta-container" containerID="cri-o://d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35" gracePeriod=30
Oct 30 21:46:11.951945 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.951888    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:46:11.966828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.966808    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-ta-internal\" (UniqueName: \"kubernetes.io/configmap/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-ta-internal\") pod \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") "
Oct 30 21:46:11.967047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.966888    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-kube-api-access-jjlsq\" (UniqueName: \"kubernetes.io/projected/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-kube-api-access-jjlsq\") pod \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") "
Oct 30 21:46:11.967047 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.966924    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-data-science-collector-ta-server-cert\") pod \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\" (UID: \"153c6319-43bb-4ee9-a4de-e86dc2dd84e8\") "
Oct 30 21:46:11.967195 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.967145    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-ta-internal" pod "153c6319-43bb-4ee9-a4de-e86dc2dd84e8" (UID: "153c6319-43bb-4ee9-a4de-e86dc2dd84e8"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:11.967263 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.967202    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:11.969191 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.969161    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-kube-api-access-jjlsq" pod "153c6319-43bb-4ee9-a4de-e86dc2dd84e8" (UID: "153c6319-43bb-4ee9-a4de-e86dc2dd84e8"). InnerVolumeSpecName "kube-api-access-jjlsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:11.969411 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:11.969382    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-data-science-collector-ta-server-cert" pod "153c6319-43bb-4ee9-a4de-e86dc2dd84e8" (UID: "153c6319-43bb-4ee9-a4de-e86dc2dd84e8"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:12.039354 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.039328    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:46:12.039524 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.039497    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="2f5019ef-075e-4a08-b644-b8a9195e2b93" containerName="perses" containerID="cri-o://5679429feac16c6fab236fa662800dd3e165a813b5d1e106da6b7d4131911438" gracePeriod=30
Oct 30 21:46:12.068364 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.068339    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjlsq\" (UniqueName: \"kubernetes.io/projected/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-kube-api-access-jjlsq\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.068364 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.068365    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/153c6319-43bb-4ee9-a4de-e86dc2dd84e8-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.181458 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.181424    5937 generic.go:356] "Generic (PLEG): container finished" podID="153c6319-43bb-4ee9-a4de-e86dc2dd84e8" containerID="d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35" exitCode=0
Oct 30 21:46:12.181670 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.181468    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"
Oct 30 21:46:12.181670 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.181494    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw" event={"ID":"153c6319-43bb-4ee9-a4de-e86dc2dd84e8","Type":"ContainerDied","Data":"d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35"}
Oct 30 21:46:12.181670 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.181560    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw" event={"ID":"153c6319-43bb-4ee9-a4de-e86dc2dd84e8","Type":"ContainerDied","Data":"8ac87860a8db232b1cf572eec5b07889a98ab357a7811cff9de07e9398f4cc31"}
Oct 30 21:46:12.181670 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.181586    5937 scope.go:122] "RemoveContainer" containerID="d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35"
Oct 30 21:46:12.183405 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.183379    5937 generic.go:356] "Generic (PLEG): container finished" podID="2f5019ef-075e-4a08-b644-b8a9195e2b93" containerID="5679429feac16c6fab236fa662800dd3e165a813b5d1e106da6b7d4131911438" exitCode=0
Oct 30 21:46:12.183498 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.183435    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"2f5019ef-075e-4a08-b644-b8a9195e2b93","Type":"ContainerDied","Data":"5679429feac16c6fab236fa662800dd3e165a813b5d1e106da6b7d4131911438"}
Oct 30 21:46:12.192103 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.191707    5937 scope.go:122] "RemoveContainer" containerID="d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35"
Oct 30 21:46:12.192103 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:46:12.192045    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35\": container with ID starting with d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35 not found: ID does not exist" containerID="d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35"
Oct 30 21:46:12.192103 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.192067    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35"} err="failed to get container status \"d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35\": rpc error: code = NotFound desc = could not find container \"d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35\": container with ID starting with d69dd43e34bae9bba206b9592f4ca2dded0d6a437fac1a7e655328eaa09dca35 not found: ID does not exist"
Oct 30 21:46:12.291389 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.291365    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:12.304477 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.304455    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"]
Oct 30 21:46:12.308718 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.308699    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-d787dcc5c-xmdgw"]
Oct 30 21:46:12.370145 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.370123    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f5019ef-075e-4a08-b644-b8a9195e2b93-config\" (UniqueName: \"kubernetes.io/configmap/2f5019ef-075e-4a08-b644-b8a9195e2b93-config\") pod \"2f5019ef-075e-4a08-b644-b8a9195e2b93\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") "
Oct 30 21:46:12.370222 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.370164    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f5019ef-075e-4a08-b644-b8a9195e2b93-plugins\" (UniqueName: \"kubernetes.io/empty-dir/2f5019ef-075e-4a08-b644-b8a9195e2b93-plugins\") pod \"2f5019ef-075e-4a08-b644-b8a9195e2b93\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") "
Oct 30 21:46:12.370281 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.370268    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"2f5019ef-075e-4a08-b644-b8a9195e2b93\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") "
Oct 30 21:46:12.370352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.370319    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f5019ef-075e-4a08-b644-b8a9195e2b93-kube-api-access-fw76v\" (UniqueName: \"kubernetes.io/projected/2f5019ef-075e-4a08-b644-b8a9195e2b93-kube-api-access-fw76v\") pod \"2f5019ef-075e-4a08-b644-b8a9195e2b93\" (UID: \"2f5019ef-075e-4a08-b644-b8a9195e2b93\") "
Oct 30 21:46:12.370503 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.370481    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f5019ef-075e-4a08-b644-b8a9195e2b93-config" pod "2f5019ef-075e-4a08-b644-b8a9195e2b93" (UID: "2f5019ef-075e-4a08-b644-b8a9195e2b93"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:12.372663 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.372638    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5019ef-075e-4a08-b644-b8a9195e2b93-kube-api-access-fw76v" pod "2f5019ef-075e-4a08-b644-b8a9195e2b93" (UID: "2f5019ef-075e-4a08-b644-b8a9195e2b93"). InnerVolumeSpecName "kube-api-access-fw76v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:12.373139 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.373117    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "2f5019ef-075e-4a08-b644-b8a9195e2b93" (UID: "2f5019ef-075e-4a08-b644-b8a9195e2b93"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:46:12.471667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.471604    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f5019ef-075e-4a08-b644-b8a9195e2b93-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.471667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.471649    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:46:12.471667 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.471663    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw76v\" (UniqueName: \"kubernetes.io/projected/2f5019ef-075e-4a08-b644-b8a9195e2b93-kube-api-access-fw76v\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.484904 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.484884    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:46:12.516969 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.516938    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f5019ef-075e-4a08-b644-b8a9195e2b93-plugins" pod "2f5019ef-075e-4a08-b644-b8a9195e2b93" (UID: "2f5019ef-075e-4a08-b644-b8a9195e2b93"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:12.572942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.572920    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/2f5019ef-075e-4a08-b644-b8a9195e2b93-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:12.572942 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:12.572941    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:46:13.164828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:13.164788    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="153c6319-43bb-4ee9-a4de-e86dc2dd84e8" path="/var/lib/kubelet/pods/153c6319-43bb-4ee9-a4de-e86dc2dd84e8/volumes"
Oct 30 21:46:13.189612 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:13.189585    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:13.189736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:13.189579    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"2f5019ef-075e-4a08-b644-b8a9195e2b93","Type":"ContainerDied","Data":"5b062b2759d34a395303497ca82c3f70c4f0a05bdc112d6418960051e2801d11"}
Oct 30 21:46:13.189736 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:13.189724    5937 scope.go:122] "RemoveContainer" containerID="5679429feac16c6fab236fa662800dd3e165a813b5d1e106da6b7d4131911438"
Oct 30 21:46:13.355946 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:13.355920    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:46:13.367754 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:13.367727    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:46:14.201613 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:14.201581    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:15.161208 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:15.161176    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f5019ef-075e-4a08-b644-b8a9195e2b93" path="/var/lib/kubelet/pods/2f5019ef-075e-4a08-b644-b8a9195e2b93/volumes"
Oct 30 21:46:15.671601 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:46:15.671568    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:46:24.201069 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:24.201034    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:29.724014 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.723981    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"]
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724327    5937 cpu_manager.go:414] "containerMap: removing container" podUID="153c6319-43bb-4ee9-a4de-e86dc2dd84e8" containerName="ta-container"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724337    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="153c6319-43bb-4ee9-a4de-e86dc2dd84e8" containerName="ta-container"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724349    5937 cpu_manager.go:414] "containerMap: removing container" podUID="3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd" containerName="thanos-querier"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724354    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd" containerName="thanos-querier"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724371    5937 cpu_manager.go:414] "containerMap: removing container" podUID="a9eab2b6-9a75-4978-96a4-ad931f5bf77c" containerName="ta-container"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724377    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9eab2b6-9a75-4978-96a4-ad931f5bf77c" containerName="ta-container"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724397    5937 cpu_manager.go:414] "containerMap: removing container" podUID="2f5019ef-075e-4a08-b644-b8a9195e2b93" containerName="perses"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724402    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f5019ef-075e-4a08-b644-b8a9195e2b93" containerName="perses"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724460    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f5019ef-075e-4a08-b644-b8a9195e2b93" containerName="perses"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724469    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="153c6319-43bb-4ee9-a4de-e86dc2dd84e8" containerName="ta-container"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724475    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="3cd868a4-ff37-4c22-a3c5-a03bcc3c3ccd" containerName="thanos-querier"
Oct 30 21:46:29.724491 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.724483    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9eab2b6-9a75-4978-96a4-ad931f5bf77c" containerName="ta-container"
Oct 30 21:46:29.727734 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.727716    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"
Oct 30 21:46:29.786497 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.786464    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"]
Oct 30 21:46:29.825710 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.825686    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxb5q\" (UniqueName: \"kubernetes.io/projected/69e210f9-d26e-401c-a377-aab0a5fe7235-kube-api-access-mxb5q\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x\" (UID: \"69e210f9-d26e-401c-a377-aab0a5fe7235\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"
Oct 30 21:46:29.835851 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.835827    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:46:29.927016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.926988    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxb5q\" (UniqueName: \"kubernetes.io/projected/69e210f9-d26e-401c-a377-aab0a5fe7235-kube-api-access-mxb5q\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x\" (UID: \"69e210f9-d26e-401c-a377-aab0a5fe7235\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"
Oct 30 21:46:29.990141 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:29.990083    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxb5q\" (UniqueName: \"kubernetes.io/projected/69e210f9-d26e-401c-a377-aab0a5fe7235-kube-api-access-mxb5q\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x\" (UID: \"69e210f9-d26e-401c-a377-aab0a5fe7235\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"
Oct 30 21:46:30.040005 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:30.039976    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"
Oct 30 21:46:30.408118 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:30.407946    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"]
Oct 30 21:46:30.411190 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:46:30.411150    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69e210f9_d26e_401c_a377_aab0a5fe7235.slice/crio-844e10fbccb25639dd9e33f338d2e454d70568de0efa780f8fb775f6bee70001 WatchSource:0}: Error finding container 844e10fbccb25639dd9e33f338d2e454d70568de0efa780f8fb775f6bee70001: Status 404 returned error can't find the container with id 844e10fbccb25639dd9e33f338d2e454d70568de0efa780f8fb775f6bee70001
Oct 30 21:46:31.264402 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:31.264364    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x" event={"ID":"69e210f9-d26e-401c-a377-aab0a5fe7235","Type":"ContainerStarted","Data":"2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91"}
Oct 30 21:46:31.264402 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:31.264405    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x" event={"ID":"69e210f9-d26e-401c-a377-aab0a5fe7235","Type":"ContainerStarted","Data":"844e10fbccb25639dd9e33f338d2e454d70568de0efa780f8fb775f6bee70001"}
Oct 30 21:46:31.381189 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:31.381144    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x" podStartSLOduration=2.381130273 podStartE2EDuration="2.381130273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:31.380687688 +0000 UTC m=+4166.336702464" watchObservedRunningTime="2026-10-30 21:46:31.381130273 +0000 UTC m=+4166.337145045"
Oct 30 21:46:33.087134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.087104    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:46:33.090632 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.090609    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.145721 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.145695    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:46:33.148609 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.148581    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:46:33.239594 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.239565    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"]
Oct 30 21:46:33.243055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.243034    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.252625 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.252596    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49bcd630-e08b-4cf3-9067-10624810dd59-config\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.252731 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.252627    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pfss\" (UniqueName: \"kubernetes.io/projected/49bcd630-e08b-4cf3-9067-10624810dd59-kube-api-access-7pfss\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.252777 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.252738    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/49bcd630-e08b-4cf3-9067-10624810dd59-plugins\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.297742 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.297708    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:46:33.297889 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.297819    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-gkz9h\""
Oct 30 21:46:33.297889 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.297832    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:46:33.303490 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.303468    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"]
Oct 30 21:46:33.353812 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.353750    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdgx2\" (UniqueName: \"kubernetes.io/projected/d42a83f5-c6a1-4ccc-949b-9955a49e170a-kube-api-access-sdgx2\") pod \"data-science-collector-targetallocator-7b5bd649ff-f4jrs\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.353812 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.353778    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d42a83f5-c6a1-4ccc-949b-9955a49e170a-ta-internal\") pod \"data-science-collector-targetallocator-7b5bd649ff-f4jrs\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.353969 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.353815    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49bcd630-e08b-4cf3-9067-10624810dd59-config\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.353969 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.353920    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d42a83f5-c6a1-4ccc-949b-9955a49e170a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7b5bd649ff-f4jrs\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.353969 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.353952    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pfss\" (UniqueName: \"kubernetes.io/projected/49bcd630-e08b-4cf3-9067-10624810dd59-kube-api-access-7pfss\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.354111 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.354054    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/49bcd630-e08b-4cf3-9067-10624810dd59-plugins\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.354377 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.354358    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/49bcd630-e08b-4cf3-9067-10624810dd59-plugins\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.354484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.354468    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49bcd630-e08b-4cf3-9067-10624810dd59-config\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.417016 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.416996    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pfss\" (UniqueName: \"kubernetes.io/projected/49bcd630-e08b-4cf3-9067-10624810dd59-kube-api-access-7pfss\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:33.455156 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.455133    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdgx2\" (UniqueName: \"kubernetes.io/projected/d42a83f5-c6a1-4ccc-949b-9955a49e170a-kube-api-access-sdgx2\") pod \"data-science-collector-targetallocator-7b5bd649ff-f4jrs\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.455271 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.455159    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d42a83f5-c6a1-4ccc-949b-9955a49e170a-ta-internal\") pod \"data-science-collector-targetallocator-7b5bd649ff-f4jrs\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.455271 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.455203    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d42a83f5-c6a1-4ccc-949b-9955a49e170a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7b5bd649ff-f4jrs\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.455817 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.455796    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d42a83f5-c6a1-4ccc-949b-9955a49e170a-ta-internal\") pod \"data-science-collector-targetallocator-7b5bd649ff-f4jrs\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.457582 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.457564    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d42a83f5-c6a1-4ccc-949b-9955a49e170a-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-7b5bd649ff-f4jrs\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.517253 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.517231    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdgx2\" (UniqueName: \"kubernetes.io/projected/d42a83f5-c6a1-4ccc-949b-9955a49e170a-kube-api-access-sdgx2\") pod \"data-science-collector-targetallocator-7b5bd649ff-f4jrs\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.554352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.554331    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:33.929828 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.929796    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"]
Oct 30 21:46:33.932252 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:46:33.932227    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd42a83f5_c6a1_4ccc_949b_9955a49e170a.slice/crio-37f166eca1c2bcef3b36e5096e92f26732201a80f397d6306b425db8c7c1c73e WatchSource:0}: Error finding container 37f166eca1c2bcef3b36e5096e92f26732201a80f397d6306b425db8c7c1c73e: Status 404 returned error can't find the container with id 37f166eca1c2bcef3b36e5096e92f26732201a80f397d6306b425db8c7c1c73e
Oct 30 21:46:33.934587 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.934526    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:33.934674 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:33.934613    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:46:34.201526 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:34.201446    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:34.278345 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:34.278310    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs" event={"ID":"d42a83f5-c6a1-4ccc-949b-9955a49e170a","Type":"ContainerStarted","Data":"74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7"}
Oct 30 21:46:34.278503 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:34.278352    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs" event={"ID":"d42a83f5-c6a1-4ccc-949b-9955a49e170a","Type":"ContainerStarted","Data":"37f166eca1c2bcef3b36e5096e92f26732201a80f397d6306b425db8c7c1c73e"}
Oct 30 21:46:34.278590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:34.278517    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:34.279416 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:34.279392    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs" podUID="d42a83f5-c6a1-4ccc-949b-9955a49e170a" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.168:8080/readyz\": dial tcp 10.134.0.168:8080: connect: connection refused"
Oct 30 21:46:34.398416 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:34.398370    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs" podStartSLOduration=1.398354041 podStartE2EDuration="1.398354041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:34.398041726 +0000 UTC m=+4169.354056496" watchObservedRunningTime="2026-10-30 21:46:34.398354041 +0000 UTC m=+4169.354368820"
Oct 30 21:46:35.284085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:35.284054    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:46:36.984204 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:36.984171    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:37.091175 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:37.091151    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:37.185135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:37.185104    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:37.185296 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:37.185204    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:37.238747 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:37.238681    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:37.377355 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:37.377329    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:37.445940 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:37.445913    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:37.601441 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:37.601371    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:37.971269 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:37.971247    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:46:37.973915 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:46:37.973892    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49bcd630_e08b_4cf3_9067_10624810dd59.slice/crio-e5dfb9f5c06c1ff3f0443868e4646b09b77ff2848b6ac98f6ba009f0e88b17a1 WatchSource:0}: Error finding container e5dfb9f5c06c1ff3f0443868e4646b09b77ff2848b6ac98f6ba009f0e88b17a1: Status 404 returned error can't find the container with id e5dfb9f5c06c1ff3f0443868e4646b09b77ff2848b6ac98f6ba009f0e88b17a1
Oct 30 21:46:38.297175 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:38.297087    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"49bcd630-e08b-4cf3-9067-10624810dd59","Type":"ContainerStarted","Data":"d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9"}
Oct 30 21:46:38.297175 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:38.297142    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"49bcd630-e08b-4cf3-9067-10624810dd59","Type":"ContainerStarted","Data":"e5dfb9f5c06c1ff3f0443868e4646b09b77ff2848b6ac98f6ba009f0e88b17a1"}
Oct 30 21:46:38.297694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:38.297179    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:38.415633 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:38.415589    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=5.415573669 podStartE2EDuration="5.415573669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:46:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:38.415188552 +0000 UTC m=+4173.371203329" watchObservedRunningTime="2026-10-30 21:46:38.415573669 +0000 UTC m=+4173.371588498"
Oct 30 21:46:44.201151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:44.201116    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:45.305457 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:45.305421    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"]
Oct 30 21:46:45.310924 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:45.310904    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"
Oct 30 21:46:45.358007 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:45.357978    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btlbq\" (UniqueName: \"kubernetes.io/projected/53a2e43d-f3b7-40e6-b341-f2b8c959018d-kube-api-access-btlbq\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7\" (UID: \"53a2e43d-f3b7-40e6-b341-f2b8c959018d\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"
Oct 30 21:46:45.366459 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:45.366433    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"]
Oct 30 21:46:45.458974 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:45.458949    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btlbq\" (UniqueName: \"kubernetes.io/projected/53a2e43d-f3b7-40e6-b341-f2b8c959018d-kube-api-access-btlbq\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7\" (UID: \"53a2e43d-f3b7-40e6-b341-f2b8c959018d\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"
Oct 30 21:46:45.523115 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:45.523090    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btlbq\" (UniqueName: \"kubernetes.io/projected/53a2e43d-f3b7-40e6-b341-f2b8c959018d-kube-api-access-btlbq\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7\" (UID: \"53a2e43d-f3b7-40e6-b341-f2b8c959018d\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"
Oct 30 21:46:45.622513 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:45.622459    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"
Oct 30 21:46:45.673277 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:46:45.673242    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:46:45.998746 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:45.998719    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"]
Oct 30 21:46:46.001442 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:46:46.001414    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53a2e43d_f3b7_40e6_b341_f2b8c959018d.slice/crio-9102d337ab1c766a773a74f4082644efc7d51a363c4ba4f2cb365d7845913421 WatchSource:0}: Error finding container 9102d337ab1c766a773a74f4082644efc7d51a363c4ba4f2cb365d7845913421: Status 404 returned error can't find the container with id 9102d337ab1c766a773a74f4082644efc7d51a363c4ba4f2cb365d7845913421
Oct 30 21:46:46.334256 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:46.334176    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7" event={"ID":"53a2e43d-f3b7-40e6-b341-f2b8c959018d","Type":"ContainerStarted","Data":"6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7"}
Oct 30 21:46:46.334256 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:46.334217    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7" event={"ID":"53a2e43d-f3b7-40e6-b341-f2b8c959018d","Type":"ContainerStarted","Data":"9102d337ab1c766a773a74f4082644efc7d51a363c4ba4f2cb365d7845913421"}
Oct 30 21:46:46.451351 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:46.451307    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7" podStartSLOduration=1.451294709 podStartE2EDuration="1.451294709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:46.451048446 +0000 UTC m=+4181.407063221" watchObservedRunningTime="2026-10-30 21:46:46.451294709 +0000 UTC m=+4181.407309484"
Oct 30 21:46:46.502529 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:46.502495    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"]
Oct 30 21:46:46.502734 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:46.502718    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x" podUID="69e210f9-d26e-401c-a377-aab0a5fe7235" containerName="thanos-querier" containerID="cri-o://2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91" gracePeriod=30
Oct 30 21:46:46.764660 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:46.764636    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"
Oct 30 21:46:46.872953 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:46.872891    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69e210f9-d26e-401c-a377-aab0a5fe7235-kube-api-access-mxb5q\" (UniqueName: \"kubernetes.io/projected/69e210f9-d26e-401c-a377-aab0a5fe7235-kube-api-access-mxb5q\") pod \"69e210f9-d26e-401c-a377-aab0a5fe7235\" (UID: \"69e210f9-d26e-401c-a377-aab0a5fe7235\") "
Oct 30 21:46:46.874914 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:46.874888    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e210f9-d26e-401c-a377-aab0a5fe7235-kube-api-access-mxb5q" pod "69e210f9-d26e-401c-a377-aab0a5fe7235" (UID: "69e210f9-d26e-401c-a377-aab0a5fe7235"). InnerVolumeSpecName "kube-api-access-mxb5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:46.974230 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:46.974197    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxb5q\" (UniqueName: \"kubernetes.io/projected/69e210f9-d26e-401c-a377-aab0a5fe7235-kube-api-access-mxb5q\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:47.340353 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:47.340301    5937 generic.go:356] "Generic (PLEG): container finished" podID="69e210f9-d26e-401c-a377-aab0a5fe7235" containerID="2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91" exitCode=0
Oct 30 21:46:47.340874 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:47.340358    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"
Oct 30 21:46:47.340874 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:47.340391    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x" event={"ID":"69e210f9-d26e-401c-a377-aab0a5fe7235","Type":"ContainerDied","Data":"2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91"}
Oct 30 21:46:47.340874 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:47.340439    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x" event={"ID":"69e210f9-d26e-401c-a377-aab0a5fe7235","Type":"ContainerDied","Data":"844e10fbccb25639dd9e33f338d2e454d70568de0efa780f8fb775f6bee70001"}
Oct 30 21:46:47.340874 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:47.340461    5937 scope.go:122] "RemoveContainer" containerID="2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91"
Oct 30 21:46:47.349485 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:47.349466    5937 scope.go:122] "RemoveContainer" containerID="2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91"
Oct 30 21:46:47.349773 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:46:47.349755    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91\": container with ID starting with 2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91 not found: ID does not exist" containerID="2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91"
Oct 30 21:46:47.349834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:47.349783    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91"} err="failed to get container status \"2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91\": rpc error: code = NotFound desc = could not find container \"2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91\": container with ID starting with 2e5b413ecd9b69ca7eb95d0d72c09607c5e1adf22125f1f4cf82b62b38395c91 not found: ID does not exist"
Oct 30 21:46:47.507480 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:47.507451    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"]
Oct 30 21:46:47.512706 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:47.512679    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-nz56x"]
Oct 30 21:46:49.160999 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.160912    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69e210f9-d26e-401c-a377-aab0a5fe7235" path="/var/lib/kubelet/pods/69e210f9-d26e-401c-a377-aab0a5fe7235/volumes"
Oct 30 21:46:49.306364 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.306335    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:46:49.358739 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.358707    5937 generic.go:356] "Generic (PLEG): container finished" podID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerID="0e67aafb1907c4211f5d8c34729e69fb07a0743568d091166aad7d59b8c77352" exitCode=137
Oct 30 21:46:49.358910 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.358834    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" event={"ID":"86c14d28-dc35-432a-a12a-7afc1cfbfc5d","Type":"ContainerDied","Data":"0e67aafb1907c4211f5d8c34729e69fb07a0743568d091166aad7d59b8c77352"}
Oct 30 21:46:49.450483 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.450461    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:46:49.496830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.496799    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-grpc\") pod \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") "
Oct 30 21:46:49.497004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.496927    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") pod \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") "
Oct 30 21:46:49.497004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.496967    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-config\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-config\") pod \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") "
Oct 30 21:46:49.497146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.497035    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ca-bundle\") pod \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") "
Oct 30 21:46:49.497146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.497073    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-kube-api-access-2n9ng\" (UniqueName: \"kubernetes.io/projected/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-kube-api-access-2n9ng\") pod \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") "
Oct 30 21:46:49.497146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.497102    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-test-logs-loki-secret\") pod \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") "
Oct 30 21:46:49.497306 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.497183    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") pod \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") "
Oct 30 21:46:49.497306 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.497243    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-http\") pod \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\" (UID: \"86c14d28-dc35-432a-a12a-7afc1cfbfc5d\") "
Oct 30 21:46:49.498462 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.498434    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-config" pod "86c14d28-dc35-432a-a12a-7afc1cfbfc5d" (UID: "86c14d28-dc35-432a-a12a-7afc1cfbfc5d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:49.498689 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.498662    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ca-bundle" pod "86c14d28-dc35-432a-a12a-7afc1cfbfc5d" (UID: "86c14d28-dc35-432a-a12a-7afc1cfbfc5d"). InnerVolumeSpecName "data-science-lokistack-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:49.500165 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.500129    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-grpc" pod "86c14d28-dc35-432a-a12a-7afc1cfbfc5d" (UID: "86c14d28-dc35-432a-a12a-7afc1cfbfc5d"). InnerVolumeSpecName "data-science-lokistack-ingester-grpc". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:49.500286 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.500159    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-test-logs-loki-secret" pod "86c14d28-dc35-432a-a12a-7afc1cfbfc5d" (UID: "86c14d28-dc35-432a-a12a-7afc1cfbfc5d"). InnerVolumeSpecName "test-logs-loki-secret". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:49.500475 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.500442    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-kube-api-access-2n9ng" pod "86c14d28-dc35-432a-a12a-7afc1cfbfc5d" (UID: "86c14d28-dc35-432a-a12a-7afc1cfbfc5d"). InnerVolumeSpecName "kube-api-access-2n9ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:49.500703 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.500683    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd" pod "86c14d28-dc35-432a-a12a-7afc1cfbfc5d" (UID: "86c14d28-dc35-432a-a12a-7afc1cfbfc5d"). InnerVolumeSpecName "pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:46:49.501009 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.500992    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-http" pod "86c14d28-dc35-432a-a12a-7afc1cfbfc5d" (UID: "86c14d28-dc35-432a-a12a-7afc1cfbfc5d"). InnerVolumeSpecName "data-science-lokistack-ingester-http". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:46:49.502004 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.501983    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4" pod "86c14d28-dc35-432a-a12a-7afc1cfbfc5d" (UID: "86c14d28-dc35-432a-a12a-7afc1cfbfc5d"). InnerVolumeSpecName "pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:46:49.598527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.598501    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ca-bundle\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:49.598527 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.598524    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n9ng\" (UniqueName: \"kubernetes.io/projected/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-kube-api-access-2n9ng\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:49.598763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.598553    5937 reconciler_common.go:299] "Volume detached for volume \"test-logs-loki-secret\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-test-logs-loki-secret\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:49.598763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.598579    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:46:49.598763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.598589    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-http\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-http\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:49.598763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.598597    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-lokistack-ingester-grpc\" (UniqueName: \"kubernetes.io/secret/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-data-science-lokistack-ingester-grpc\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:49.598763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.598613    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:46:49.598763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.598623    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86c14d28-dc35-432a-a12a-7afc1cfbfc5d-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:49.606849 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.606832    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:46:49.608815 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.608800    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:46:49.699837 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.699773    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-131e8973-65e7-42a5-b6de-66bac3aaa3de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-03927daadcd54c5fd\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-449db449f5083caccf1f54611cc314da97b72a473d33be59fafa5eab0caa75eb\""
Oct 30 21:46:49.699837 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:49.699796    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-8aeffca6-5b2e-415b-a56b-047d4dab0ae9\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-09b157f15e1982db4\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-841ff7316bc20493f777778bb1b75fb4959885499ab232447c6f04ac452e1878\""
Oct 30 21:46:50.364763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:50.364722    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0" event={"ID":"86c14d28-dc35-432a-a12a-7afc1cfbfc5d","Type":"ContainerDied","Data":"3c264fe8e51e287f334cb380cd1d716ce4235c9acc92a45bc1f8043d5ed13084"}
Oct 30 21:46:50.364763 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:50.364757    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-lokistack-ingester-0"
Oct 30 21:46:50.365264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:50.364780    5937 scope.go:122] "RemoveContainer" containerID="0e67aafb1907c4211f5d8c34729e69fb07a0743568d091166aad7d59b8c77352"
Oct 30 21:46:50.534666 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:50.534638    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-0"]
Oct 30 21:46:50.585237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:50.585207    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-lokistack-ingester-0"]
Oct 30 21:46:51.161770 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:46:51.161737    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" path="/var/lib/kubelet/pods/86c14d28-dc35-432a-a12a-7afc1cfbfc5d/volumes"
Oct 30 21:47:15.671809 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:47:15.671772    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:47:20.324742 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.324709    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"]
Oct 30 21:47:20.325133 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.325055    5937 cpu_manager.go:414] "containerMap: removing container" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester"
Oct 30 21:47:20.325133 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.325067    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester"
Oct 30 21:47:20.325133 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.325089    5937 cpu_manager.go:414] "containerMap: removing container" podUID="69e210f9-d26e-401c-a377-aab0a5fe7235" containerName="thanos-querier"
Oct 30 21:47:20.325133 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.325094    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69e210f9-d26e-401c-a377-aab0a5fe7235" containerName="thanos-querier"
Oct 30 21:47:20.325264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.325151    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="86c14d28-dc35-432a-a12a-7afc1cfbfc5d" containerName="loki-ingester"
Oct 30 21:47:20.325264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.325161    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="69e210f9-d26e-401c-a377-aab0a5fe7235" containerName="thanos-querier"
Oct 30 21:47:20.328088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.328074    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.386704 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.386679    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"]
Oct 30 21:47:20.463923 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.463890    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/2597e822-83f2-4231-8c80-9ba4270b0f13-kube-api-access-drzpt\") pod \"data-science-collector-targetallocator-6c465b7c4-wt4bt\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.464088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.463936    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2597e822-83f2-4231-8c80-9ba4270b0f13-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c465b7c4-wt4bt\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.464088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.464038    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2597e822-83f2-4231-8c80-9ba4270b0f13-ta-internal\") pod \"data-science-collector-targetallocator-6c465b7c4-wt4bt\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.565145 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.565115    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/2597e822-83f2-4231-8c80-9ba4270b0f13-kube-api-access-drzpt\") pod \"data-science-collector-targetallocator-6c465b7c4-wt4bt\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.565295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.565157    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2597e822-83f2-4231-8c80-9ba4270b0f13-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c465b7c4-wt4bt\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.565295 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.565197    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2597e822-83f2-4231-8c80-9ba4270b0f13-ta-internal\") pod \"data-science-collector-targetallocator-6c465b7c4-wt4bt\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.565831 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.565813    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2597e822-83f2-4231-8c80-9ba4270b0f13-ta-internal\") pod \"data-science-collector-targetallocator-6c465b7c4-wt4bt\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.567784 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.567764    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2597e822-83f2-4231-8c80-9ba4270b0f13-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-6c465b7c4-wt4bt\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.627212 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.627146    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/2597e822-83f2-4231-8c80-9ba4270b0f13-kube-api-access-drzpt\") pod \"data-science-collector-targetallocator-6c465b7c4-wt4bt\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:20.638983 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:20.638953    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:21.013910 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:21.013866    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"]
Oct 30 21:47:21.016419 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:47:21.016388    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2597e822_83f2_4231_8c80_9ba4270b0f13.slice/crio-2cd1c878d3bba0d1d51c25686dddea2d9f04b55077d3baa3d4ac9da9a29fb0a6 WatchSource:0}: Error finding container 2cd1c878d3bba0d1d51c25686dddea2d9f04b55077d3baa3d4ac9da9a29fb0a6: Status 404 returned error can't find the container with id 2cd1c878d3bba0d1d51c25686dddea2d9f04b55077d3baa3d4ac9da9a29fb0a6
Oct 30 21:47:21.018484 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:21.018452    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:21.018593 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:21.018514    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:21.496422 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:21.496390    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt" event={"ID":"2597e822-83f2-4231-8c80-9ba4270b0f13","Type":"ContainerStarted","Data":"9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30"}
Oct 30 21:47:21.496832 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:21.496431    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt" event={"ID":"2597e822-83f2-4231-8c80-9ba4270b0f13","Type":"ContainerStarted","Data":"2cd1c878d3bba0d1d51c25686dddea2d9f04b55077d3baa3d4ac9da9a29fb0a6"}
Oct 30 21:47:21.496832 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:21.496531    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:21.497599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:21.497578    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt" podUID="2597e822-83f2-4231-8c80-9ba4270b0f13" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.170:8080/readyz\": dial tcp 10.134.0.170:8080: connect: connection refused"
Oct 30 21:47:21.615439 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:21.615386    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt" podStartSLOduration=1.615370758 podStartE2EDuration="1.615370758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:21.614624857 +0000 UTC m=+4216.570639635" watchObservedRunningTime="2026-10-30 21:47:21.615370758 +0000 UTC m=+4216.571385534"
Oct 30 21:47:22.502231 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:22.502202    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:22.674621 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:22.674587    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"]
Oct 30 21:47:22.674820 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:22.674780    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs" podUID="d42a83f5-c6a1-4ccc-949b-9955a49e170a" containerName="ta-container" containerID="cri-o://74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7" gracePeriod=30
Oct 30 21:47:22.922712 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:22.922687    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:47:22.985623 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:22.985602    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d42a83f5-c6a1-4ccc-949b-9955a49e170a-kube-api-access-sdgx2\" (UniqueName: \"kubernetes.io/projected/d42a83f5-c6a1-4ccc-949b-9955a49e170a-kube-api-access-sdgx2\") pod \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") "
Oct 30 21:47:22.985748 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:22.985666    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d42a83f5-c6a1-4ccc-949b-9955a49e170a-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d42a83f5-c6a1-4ccc-949b-9955a49e170a-data-science-collector-ta-server-cert\") pod \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") "
Oct 30 21:47:22.987745 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:22.987711    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42a83f5-c6a1-4ccc-949b-9955a49e170a-kube-api-access-sdgx2" pod "d42a83f5-c6a1-4ccc-949b-9955a49e170a" (UID: "d42a83f5-c6a1-4ccc-949b-9955a49e170a"). InnerVolumeSpecName "kube-api-access-sdgx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:47:22.987854 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:22.987774    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d42a83f5-c6a1-4ccc-949b-9955a49e170a-data-science-collector-ta-server-cert" pod "d42a83f5-c6a1-4ccc-949b-9955a49e170a" (UID: "d42a83f5-c6a1-4ccc-949b-9955a49e170a"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:23.086821 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.086758    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d42a83f5-c6a1-4ccc-949b-9955a49e170a-ta-internal\" (UniqueName: \"kubernetes.io/configmap/d42a83f5-c6a1-4ccc-949b-9955a49e170a-ta-internal\") pod \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\" (UID: \"d42a83f5-c6a1-4ccc-949b-9955a49e170a\") "
Oct 30 21:47:23.086933 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.086904    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdgx2\" (UniqueName: \"kubernetes.io/projected/d42a83f5-c6a1-4ccc-949b-9955a49e170a-kube-api-access-sdgx2\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:23.086933 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.086917    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/d42a83f5-c6a1-4ccc-949b-9955a49e170a-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:23.087069 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.087048    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d42a83f5-c6a1-4ccc-949b-9955a49e170a-ta-internal" pod "d42a83f5-c6a1-4ccc-949b-9955a49e170a" (UID: "d42a83f5-c6a1-4ccc-949b-9955a49e170a"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:23.187647 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.187621    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/d42a83f5-c6a1-4ccc-949b-9955a49e170a-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:23.506858 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.506822    5937 generic.go:356] "Generic (PLEG): container finished" podID="d42a83f5-c6a1-4ccc-949b-9955a49e170a" containerID="74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7" exitCode=0
Oct 30 21:47:23.507293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.506868    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"
Oct 30 21:47:23.507293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.506914    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs" event={"ID":"d42a83f5-c6a1-4ccc-949b-9955a49e170a","Type":"ContainerDied","Data":"74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7"}
Oct 30 21:47:23.507293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.506959    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs" event={"ID":"d42a83f5-c6a1-4ccc-949b-9955a49e170a","Type":"ContainerDied","Data":"37f166eca1c2bcef3b36e5096e92f26732201a80f397d6306b425db8c7c1c73e"}
Oct 30 21:47:23.507293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.506980    5937 scope.go:122] "RemoveContainer" containerID="74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7"
Oct 30 21:47:23.515439 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.515423    5937 scope.go:122] "RemoveContainer" containerID="74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7"
Oct 30 21:47:23.515719 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:47:23.515701    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7\": container with ID starting with 74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7 not found: ID does not exist" containerID="74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7"
Oct 30 21:47:23.515792 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.515726    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7"} err="failed to get container status \"74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7\": rpc error: code = NotFound desc = could not find container \"74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7\": container with ID starting with 74a1fb24a299950f1f8edeb53a7cdb49eaba560869d945fe86b71fd10ec818e7 not found: ID does not exist"
Oct 30 21:47:23.672637 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.672612    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"]
Oct 30 21:47:23.679232 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:23.679213    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-7b5bd649ff-f4jrs"]
Oct 30 21:47:25.161851 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:25.161817    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d42a83f5-c6a1-4ccc-949b-9955a49e170a" path="/var/lib/kubelet/pods/d42a83f5-c6a1-4ccc-949b-9955a49e170a/volumes"
Oct 30 21:47:45.672243 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:47:45.672161    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:47:52.185729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.185687    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"]
Oct 30 21:47:52.186344 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.186074    5937 cpu_manager.go:414] "containerMap: removing container" podUID="d42a83f5-c6a1-4ccc-949b-9955a49e170a" containerName="ta-container"
Oct 30 21:47:52.186344 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.186086    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d42a83f5-c6a1-4ccc-949b-9955a49e170a" containerName="ta-container"
Oct 30 21:47:52.186344 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.186157    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="d42a83f5-c6a1-4ccc-949b-9955a49e170a" containerName="ta-container"
Oct 30 21:47:52.189197 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.189178    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.250830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.250799    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"]
Oct 30 21:47:52.329672 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.329646    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tmtz\" (UniqueName: \"kubernetes.io/projected/0360af37-b952-4775-ac77-1e90c229e1e9-kube-api-access-9tmtz\") pod \"data-science-collector-targetallocator-559f7ccbf-qk8k6\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.329830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.329690    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0360af37-b952-4775-ac77-1e90c229e1e9-ta-internal\") pod \"data-science-collector-targetallocator-559f7ccbf-qk8k6\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.329830 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.329717    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0360af37-b952-4775-ac77-1e90c229e1e9-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-559f7ccbf-qk8k6\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.430509 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.430484    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0360af37-b952-4775-ac77-1e90c229e1e9-ta-internal\") pod \"data-science-collector-targetallocator-559f7ccbf-qk8k6\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.430677 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.430560    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0360af37-b952-4775-ac77-1e90c229e1e9-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-559f7ccbf-qk8k6\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.430677 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.430635    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tmtz\" (UniqueName: \"kubernetes.io/projected/0360af37-b952-4775-ac77-1e90c229e1e9-kube-api-access-9tmtz\") pod \"data-science-collector-targetallocator-559f7ccbf-qk8k6\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.431085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.431066    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0360af37-b952-4775-ac77-1e90c229e1e9-ta-internal\") pod \"data-science-collector-targetallocator-559f7ccbf-qk8k6\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.433116 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.433081    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0360af37-b952-4775-ac77-1e90c229e1e9-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-559f7ccbf-qk8k6\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.504933 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.504908    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tmtz\" (UniqueName: \"kubernetes.io/projected/0360af37-b952-4775-ac77-1e90c229e1e9-kube-api-access-9tmtz\") pod \"data-science-collector-targetallocator-559f7ccbf-qk8k6\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:52.800840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:52.800761    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:53.180668 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:53.180602    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"]
Oct 30 21:47:53.183029 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:47:53.183000    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0360af37_b952_4775_ac77_1e90c229e1e9.slice/crio-37000803848bc2890eb4fbbaff83c880b2b305dca2d3e9959a12e828dbc0db18 WatchSource:0}: Error finding container 37000803848bc2890eb4fbbaff83c880b2b305dca2d3e9959a12e828dbc0db18: Status 404 returned error can't find the container with id 37000803848bc2890eb4fbbaff83c880b2b305dca2d3e9959a12e828dbc0db18
Oct 30 21:47:53.184983 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:53.184956    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:53.185068 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:53.185004    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:47:53.634979 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:53.634947    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6" event={"ID":"0360af37-b952-4775-ac77-1e90c229e1e9","Type":"ContainerStarted","Data":"d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388"}
Oct 30 21:47:53.635352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:53.634989    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6" event={"ID":"0360af37-b952-4775-ac77-1e90c229e1e9","Type":"ContainerStarted","Data":"37000803848bc2890eb4fbbaff83c880b2b305dca2d3e9959a12e828dbc0db18"}
Oct 30 21:47:53.635352 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:53.635153    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:53.636204 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:53.636180    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6" podUID="0360af37-b952-4775-ac77-1e90c229e1e9" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.171:8080/readyz\": dial tcp 10.134.0.171:8080: connect: connection refused"
Oct 30 21:47:53.756057 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:53.756017    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6" podStartSLOduration=1.756004321 podStartE2EDuration="1.756004321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:53.754825515 +0000 UTC m=+4248.710840292" watchObservedRunningTime="2026-10-30 21:47:53.756004321 +0000 UTC m=+4248.712019074"
Oct 30 21:47:54.639850 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:54.639823    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:47:54.813961 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:54.813932    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"]
Oct 30 21:47:54.814135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:54.814113    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt" podUID="2597e822-83f2-4231-8c80-9ba4270b0f13" containerName="ta-container" containerID="cri-o://9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30" gracePeriod=30
Oct 30 21:47:55.053781 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.053750    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:55.156523 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.156493    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2597e822-83f2-4231-8c80-9ba4270b0f13-kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/2597e822-83f2-4231-8c80-9ba4270b0f13-kube-api-access-drzpt\") pod \"2597e822-83f2-4231-8c80-9ba4270b0f13\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") "
Oct 30 21:47:55.156695 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.156615    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2597e822-83f2-4231-8c80-9ba4270b0f13-ta-internal\" (UniqueName: \"kubernetes.io/configmap/2597e822-83f2-4231-8c80-9ba4270b0f13-ta-internal\") pod \"2597e822-83f2-4231-8c80-9ba4270b0f13\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") "
Oct 30 21:47:55.156695 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.156646    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2597e822-83f2-4231-8c80-9ba4270b0f13-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2597e822-83f2-4231-8c80-9ba4270b0f13-data-science-collector-ta-server-cert\") pod \"2597e822-83f2-4231-8c80-9ba4270b0f13\" (UID: \"2597e822-83f2-4231-8c80-9ba4270b0f13\") "
Oct 30 21:47:55.156984 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.156958    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2597e822-83f2-4231-8c80-9ba4270b0f13-ta-internal" pod "2597e822-83f2-4231-8c80-9ba4270b0f13" (UID: "2597e822-83f2-4231-8c80-9ba4270b0f13"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:47:55.158887 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.158859    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2597e822-83f2-4231-8c80-9ba4270b0f13-data-science-collector-ta-server-cert" pod "2597e822-83f2-4231-8c80-9ba4270b0f13" (UID: "2597e822-83f2-4231-8c80-9ba4270b0f13"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:47:55.159071 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.159056    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2597e822-83f2-4231-8c80-9ba4270b0f13-kube-api-access-drzpt" pod "2597e822-83f2-4231-8c80-9ba4270b0f13" (UID: "2597e822-83f2-4231-8c80-9ba4270b0f13"). InnerVolumeSpecName "kube-api-access-drzpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:47:55.257721 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.257700    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/2597e822-83f2-4231-8c80-9ba4270b0f13-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:55.257721 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.257723    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/2597e822-83f2-4231-8c80-9ba4270b0f13-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:55.257890 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.257732    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drzpt\" (UniqueName: \"kubernetes.io/projected/2597e822-83f2-4231-8c80-9ba4270b0f13-kube-api-access-drzpt\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:47:55.644382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.644294    5937 generic.go:356] "Generic (PLEG): container finished" podID="2597e822-83f2-4231-8c80-9ba4270b0f13" containerID="9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30" exitCode=0
Oct 30 21:47:55.644382 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.644348    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"
Oct 30 21:47:55.644900 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.644386    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt" event={"ID":"2597e822-83f2-4231-8c80-9ba4270b0f13","Type":"ContainerDied","Data":"9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30"}
Oct 30 21:47:55.644900 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.644435    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt" event={"ID":"2597e822-83f2-4231-8c80-9ba4270b0f13","Type":"ContainerDied","Data":"2cd1c878d3bba0d1d51c25686dddea2d9f04b55077d3baa3d4ac9da9a29fb0a6"}
Oct 30 21:47:55.644900 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.644454    5937 scope.go:122] "RemoveContainer" containerID="9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30"
Oct 30 21:47:55.652488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.652471    5937 scope.go:122] "RemoveContainer" containerID="9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30"
Oct 30 21:47:55.652806 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:47:55.652788    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30\": container with ID starting with 9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30 not found: ID does not exist" containerID="9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30"
Oct 30 21:47:55.652877 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.652818    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30"} err="failed to get container status \"9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30\": rpc error: code = NotFound desc = could not find container \"9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30\": container with ID starting with 9d4ba626e68acadebbed4192fb215eac9ba5b4b9309a4b0f9e3977cac5ef6d30 not found: ID does not exist"
Oct 30 21:47:55.811423 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.811398    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"]
Oct 30 21:47:55.862118 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:55.862097    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-6c465b7c4-wt4bt"]
Oct 30 21:47:57.161225 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:47:57.161179    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2597e822-83f2-4231-8c80-9ba4270b0f13" path="/var/lib/kubelet/pods/2597e822-83f2-4231-8c80-9ba4270b0f13/volumes"
Oct 30 21:48:09.706134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:09.706100    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"]
Oct 30 21:48:09.706566 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:09.706316    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7" podUID="53a2e43d-f3b7-40e6-b341-f2b8c959018d" containerName="thanos-querier" containerID="cri-o://6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7" gracePeriod=30
Oct 30 21:48:09.944091 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:09.944068    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"
Oct 30 21:48:10.082975 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.082903    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53a2e43d-f3b7-40e6-b341-f2b8c959018d-kube-api-access-btlbq\" (UniqueName: \"kubernetes.io/projected/53a2e43d-f3b7-40e6-b341-f2b8c959018d-kube-api-access-btlbq\") pod \"53a2e43d-f3b7-40e6-b341-f2b8c959018d\" (UID: \"53a2e43d-f3b7-40e6-b341-f2b8c959018d\") "
Oct 30 21:48:10.085052 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.085028    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53a2e43d-f3b7-40e6-b341-f2b8c959018d-kube-api-access-btlbq" pod "53a2e43d-f3b7-40e6-b341-f2b8c959018d" (UID: "53a2e43d-f3b7-40e6-b341-f2b8c959018d"). InnerVolumeSpecName "kube-api-access-btlbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:10.184545 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.184511    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btlbq\" (UniqueName: \"kubernetes.io/projected/53a2e43d-f3b7-40e6-b341-f2b8c959018d-kube-api-access-btlbq\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:10.709752 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.709720    5937 generic.go:356] "Generic (PLEG): container finished" podID="53a2e43d-f3b7-40e6-b341-f2b8c959018d" containerID="6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7" exitCode=0
Oct 30 21:48:10.710224 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.709769    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"
Oct 30 21:48:10.710224 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.709815    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7" event={"ID":"53a2e43d-f3b7-40e6-b341-f2b8c959018d","Type":"ContainerDied","Data":"6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7"}
Oct 30 21:48:10.710224 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.709861    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7" event={"ID":"53a2e43d-f3b7-40e6-b341-f2b8c959018d","Type":"ContainerDied","Data":"9102d337ab1c766a773a74f4082644efc7d51a363c4ba4f2cb365d7845913421"}
Oct 30 21:48:10.710224 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.709885    5937 scope.go:122] "RemoveContainer" containerID="6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7"
Oct 30 21:48:10.719036 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.719016    5937 scope.go:122] "RemoveContainer" containerID="6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7"
Oct 30 21:48:10.719286 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:48:10.719268    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7\": container with ID starting with 6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7 not found: ID does not exist" containerID="6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7"
Oct 30 21:48:10.719361 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.719294    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7"} err="failed to get container status \"6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7\": rpc error: code = NotFound desc = could not find container \"6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7\": container with ID starting with 6b92bc1fa47ea6d19c1720cdec14e06c906f0056631ed3a8b3c58909e7d7b9c7 not found: ID does not exist"
Oct 30 21:48:10.881628 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.881598    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"]
Oct 30 21:48:10.932096 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:10.932069    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-r7gv7"]
Oct 30 21:48:11.160730 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:11.160657    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53a2e43d-f3b7-40e6-b341-f2b8c959018d" path="/var/lib/kubelet/pods/53a2e43d-f3b7-40e6-b341-f2b8c959018d/volumes"
Oct 30 21:48:12.404856 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.404826    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"]
Oct 30 21:48:12.405299 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.405027    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6" podUID="0360af37-b952-4775-ac77-1e90c229e1e9" containerName="ta-container" containerID="cri-o://d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388" gracePeriod=30
Oct 30 21:48:12.652138 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.652112    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:48:12.712589 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.703253    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:48:12.719787 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.719760    5937 generic.go:356] "Generic (PLEG): container finished" podID="0360af37-b952-4775-ac77-1e90c229e1e9" containerID="d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388" exitCode=0
Oct 30 21:48:12.719920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.719800    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"
Oct 30 21:48:12.719920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.719846    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6" event={"ID":"0360af37-b952-4775-ac77-1e90c229e1e9","Type":"ContainerDied","Data":"d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388"}
Oct 30 21:48:12.719920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.719881    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6" event={"ID":"0360af37-b952-4775-ac77-1e90c229e1e9","Type":"ContainerDied","Data":"37000803848bc2890eb4fbbaff83c880b2b305dca2d3e9959a12e828dbc0db18"}
Oct 30 21:48:12.719920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.719901    5937 scope.go:122] "RemoveContainer" containerID="d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388"
Oct 30 21:48:12.720098 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.719963    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="49bcd630-e08b-4cf3-9067-10624810dd59" containerName="perses" containerID="cri-o://d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9" gracePeriod=30
Oct 30 21:48:12.729565 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.729514    5937 scope.go:122] "RemoveContainer" containerID="d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388"
Oct 30 21:48:12.729843 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:48:12.729826    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388\": container with ID starting with d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388 not found: ID does not exist" containerID="d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388"
Oct 30 21:48:12.729901 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.729849    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388"} err="failed to get container status \"d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388\": rpc error: code = NotFound desc = could not find container \"d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388\": container with ID starting with d65d7d189e5464aaa1384f367739136d51ad2775a7eabd02f71984fe48e2b388 not found: ID does not exist"
Oct 30 21:48:12.810164 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.810138    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0360af37-b952-4775-ac77-1e90c229e1e9-kube-api-access-9tmtz\" (UniqueName: \"kubernetes.io/projected/0360af37-b952-4775-ac77-1e90c229e1e9-kube-api-access-9tmtz\") pod \"0360af37-b952-4775-ac77-1e90c229e1e9\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") "
Oct 30 21:48:12.810325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.810175    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0360af37-b952-4775-ac77-1e90c229e1e9-ta-internal\" (UniqueName: \"kubernetes.io/configmap/0360af37-b952-4775-ac77-1e90c229e1e9-ta-internal\") pod \"0360af37-b952-4775-ac77-1e90c229e1e9\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") "
Oct 30 21:48:12.810325 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.810256    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0360af37-b952-4775-ac77-1e90c229e1e9-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0360af37-b952-4775-ac77-1e90c229e1e9-data-science-collector-ta-server-cert\") pod \"0360af37-b952-4775-ac77-1e90c229e1e9\" (UID: \"0360af37-b952-4775-ac77-1e90c229e1e9\") "
Oct 30 21:48:12.810611 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.810586    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0360af37-b952-4775-ac77-1e90c229e1e9-ta-internal" pod "0360af37-b952-4775-ac77-1e90c229e1e9" (UID: "0360af37-b952-4775-ac77-1e90c229e1e9"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:12.812490 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.812464    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0360af37-b952-4775-ac77-1e90c229e1e9-data-science-collector-ta-server-cert" pod "0360af37-b952-4775-ac77-1e90c229e1e9" (UID: "0360af37-b952-4775-ac77-1e90c229e1e9"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:48:12.812490 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.812478    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0360af37-b952-4775-ac77-1e90c229e1e9-kube-api-access-9tmtz" pod "0360af37-b952-4775-ac77-1e90c229e1e9" (UID: "0360af37-b952-4775-ac77-1e90c229e1e9"). InnerVolumeSpecName "kube-api-access-9tmtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:12.911138 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.911113    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tmtz\" (UniqueName: \"kubernetes.io/projected/0360af37-b952-4775-ac77-1e90c229e1e9-kube-api-access-9tmtz\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:12.911138 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.911141    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/0360af37-b952-4775-ac77-1e90c229e1e9-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:12.911302 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.911152    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/0360af37-b952-4775-ac77-1e90c229e1e9-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:12.953977 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:12.953952    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:13.112291 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.112268    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49bcd630-e08b-4cf3-9067-10624810dd59-plugins\" (UniqueName: \"kubernetes.io/empty-dir/49bcd630-e08b-4cf3-9067-10624810dd59-plugins\") pod \"49bcd630-e08b-4cf3-9067-10624810dd59\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") "
Oct 30 21:48:13.112427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.112317    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49bcd630-e08b-4cf3-9067-10624810dd59-kube-api-access-7pfss\" (UniqueName: \"kubernetes.io/projected/49bcd630-e08b-4cf3-9067-10624810dd59-kube-api-access-7pfss\") pod \"49bcd630-e08b-4cf3-9067-10624810dd59\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") "
Oct 30 21:48:13.112427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.112401    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"49bcd630-e08b-4cf3-9067-10624810dd59\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") "
Oct 30 21:48:13.112590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.112438    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49bcd630-e08b-4cf3-9067-10624810dd59-config\" (UniqueName: \"kubernetes.io/configmap/49bcd630-e08b-4cf3-9067-10624810dd59-config\") pod \"49bcd630-e08b-4cf3-9067-10624810dd59\" (UID: \"49bcd630-e08b-4cf3-9067-10624810dd59\") "
Oct 30 21:48:13.112851 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.112823    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49bcd630-e08b-4cf3-9067-10624810dd59-config" pod "49bcd630-e08b-4cf3-9067-10624810dd59" (UID: "49bcd630-e08b-4cf3-9067-10624810dd59"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:13.114751 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.114724    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49bcd630-e08b-4cf3-9067-10624810dd59-kube-api-access-7pfss" pod "49bcd630-e08b-4cf3-9067-10624810dd59" (UID: "49bcd630-e08b-4cf3-9067-10624810dd59"). InnerVolumeSpecName "kube-api-access-7pfss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:13.115404 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.115384    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "49bcd630-e08b-4cf3-9067-10624810dd59" (UID: "49bcd630-e08b-4cf3-9067-10624810dd59"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:48:13.184041 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.184013    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"]
Oct 30 21:48:13.187915 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.187890    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-559f7ccbf-qk8k6"]
Oct 30 21:48:13.213645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.213618    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49bcd630-e08b-4cf3-9067-10624810dd59-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.213645 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.213642    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pfss\" (UniqueName: \"kubernetes.io/projected/49bcd630-e08b-4cf3-9067-10624810dd59-kube-api-access-7pfss\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.213808 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.213679    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:48:13.223764 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.223747    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:48:13.259984 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.259955    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49bcd630-e08b-4cf3-9067-10624810dd59-plugins" pod "49bcd630-e08b-4cf3-9067-10624810dd59" (UID: "49bcd630-e08b-4cf3-9067-10624810dd59"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:13.314130 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.314066    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/49bcd630-e08b-4cf3-9067-10624810dd59-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:13.314130 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.314090    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:48:13.727373 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.727341    5937 generic.go:356] "Generic (PLEG): container finished" podID="49bcd630-e08b-4cf3-9067-10624810dd59" containerID="d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9" exitCode=0
Oct 30 21:48:13.727840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.727387    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:13.727840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.727387    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"49bcd630-e08b-4cf3-9067-10624810dd59","Type":"ContainerDied","Data":"d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9"}
Oct 30 21:48:13.727840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.727551    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"49bcd630-e08b-4cf3-9067-10624810dd59","Type":"ContainerDied","Data":"e5dfb9f5c06c1ff3f0443868e4646b09b77ff2848b6ac98f6ba009f0e88b17a1"}
Oct 30 21:48:13.727840 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.727587    5937 scope.go:122] "RemoveContainer" containerID="d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9"
Oct 30 21:48:13.735968 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.735948    5937 scope.go:122] "RemoveContainer" containerID="d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9"
Oct 30 21:48:13.736228 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:48:13.736208    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9\": container with ID starting with d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9 not found: ID does not exist" containerID="d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9"
Oct 30 21:48:13.736296 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.736240    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9"} err="failed to get container status \"d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9\": rpc error: code = NotFound desc = could not find container \"d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9\": container with ID starting with d7729fd0e7b14268eef9eb6b239bba06d3efd7ec6617d4e3f6e59b37c285d8d9 not found: ID does not exist"
Oct 30 21:48:13.893209 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.893176    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:48:13.943510 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:13.943481    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:48:15.161124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:15.161090    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0360af37-b952-4775-ac77-1e90c229e1e9" path="/var/lib/kubelet/pods/0360af37-b952-4775-ac77-1e90c229e1e9/volumes"
Oct 30 21:48:15.161558 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:15.161527    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49bcd630-e08b-4cf3-9067-10624810dd59" path="/var/lib/kubelet/pods/49bcd630-e08b-4cf3-9067-10624810dd59/volumes"
Oct 30 21:48:15.670527 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:48:15.670487    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:48:35.395358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395331    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"]
Oct 30 21:48:35.395834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395702    5937 cpu_manager.go:414] "containerMap: removing container" podUID="49bcd630-e08b-4cf3-9067-10624810dd59" containerName="perses"
Oct 30 21:48:35.395834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395714    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49bcd630-e08b-4cf3-9067-10624810dd59" containerName="perses"
Oct 30 21:48:35.395834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395737    5937 cpu_manager.go:414] "containerMap: removing container" podUID="0360af37-b952-4775-ac77-1e90c229e1e9" containerName="ta-container"
Oct 30 21:48:35.395834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395742    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0360af37-b952-4775-ac77-1e90c229e1e9" containerName="ta-container"
Oct 30 21:48:35.395834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395761    5937 cpu_manager.go:414] "containerMap: removing container" podUID="53a2e43d-f3b7-40e6-b341-f2b8c959018d" containerName="thanos-querier"
Oct 30 21:48:35.395834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395768    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53a2e43d-f3b7-40e6-b341-f2b8c959018d" containerName="thanos-querier"
Oct 30 21:48:35.395834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395783    5937 cpu_manager.go:414] "containerMap: removing container" podUID="2597e822-83f2-4231-8c80-9ba4270b0f13" containerName="ta-container"
Oct 30 21:48:35.395834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395788    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2597e822-83f2-4231-8c80-9ba4270b0f13" containerName="ta-container"
Oct 30 21:48:35.395834 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395838    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="0360af37-b952-4775-ac77-1e90c229e1e9" containerName="ta-container"
Oct 30 21:48:35.396105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395852    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="53a2e43d-f3b7-40e6-b341-f2b8c959018d" containerName="thanos-querier"
Oct 30 21:48:35.396105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395863    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="2597e822-83f2-4231-8c80-9ba4270b0f13" containerName="ta-container"
Oct 30 21:48:35.396105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.395869    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="49bcd630-e08b-4cf3-9067-10624810dd59" containerName="perses"
Oct 30 21:48:35.399018 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.398998    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"
Oct 30 21:48:35.455987 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.455964    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"]
Oct 30 21:48:35.472801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.472777    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzbpr\" (UniqueName: \"kubernetes.io/projected/ce51131a-c064-4b18-910c-01ab19af7ff8-kube-api-access-tzbpr\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q\" (UID: \"ce51131a-c064-4b18-910c-01ab19af7ff8\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"
Oct 30 21:48:35.505862 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.505840    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:48:35.505966 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.505908    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"default-dockercfg-48j4p\""
Oct 30 21:48:35.506126 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.506112    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:48:35.574105 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.574080    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzbpr\" (UniqueName: \"kubernetes.io/projected/ce51131a-c064-4b18-910c-01ab19af7ff8-kube-api-access-tzbpr\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q\" (UID: \"ce51131a-c064-4b18-910c-01ab19af7ff8\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"
Oct 30 21:48:35.637073 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.637047    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzbpr\" (UniqueName: \"kubernetes.io/projected/ce51131a-c064-4b18-910c-01ab19af7ff8-kube-api-access-tzbpr\") pod \"thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q\" (UID: \"ce51131a-c064-4b18-910c-01ab19af7ff8\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"
Oct 30 21:48:35.710350 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:35.710308    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"
Oct 30 21:48:36.080566 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:36.080467    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"]
Oct 30 21:48:36.083384 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:48:36.083354    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce51131a_c064_4b18_910c_01ab19af7ff8.slice/crio-88b6d6515a5eecb89320efcb86bb50d87305c9c7e5ec00e0d8b2065dc7ee75f3 WatchSource:0}: Error finding container 88b6d6515a5eecb89320efcb86bb50d87305c9c7e5ec00e0d8b2065dc7ee75f3: Status 404 returned error can't find the container with id 88b6d6515a5eecb89320efcb86bb50d87305c9c7e5ec00e0d8b2065dc7ee75f3
Oct 30 21:48:36.824850 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:36.824813    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q" event={"ID":"ce51131a-c064-4b18-910c-01ab19af7ff8","Type":"ContainerStarted","Data":"a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b"}
Oct 30 21:48:36.824850 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:36.824855    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q" event={"ID":"ce51131a-c064-4b18-910c-01ab19af7ff8","Type":"ContainerStarted","Data":"88b6d6515a5eecb89320efcb86bb50d87305c9c7e5ec00e0d8b2065dc7ee75f3"}
Oct 30 21:48:36.941310 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:36.941256    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q" podStartSLOduration=1.941243172 podStartE2EDuration="1.941243172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:36.940960096 +0000 UTC m=+4291.896974873" watchObservedRunningTime="2026-10-30 21:48:36.941243172 +0000 UTC m=+4291.897258024"
Oct 30 21:48:38.592310 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.592278    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:48:38.595778 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.595762    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.656728 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.656697    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:48:38.698826 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.698791    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2j4z\" (UniqueName: \"kubernetes.io/projected/24b9850d-fec1-4b53-a196-76bb3bfda603-kube-api-access-w2j4z\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.698957 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.698838    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.698957 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.698912    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.699055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.698958    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.699055 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.698988    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.699141 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.699062    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/24b9850d-fec1-4b53-a196-76bb3bfda603-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.700458 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.700444    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-tls\""
Oct 30 21:48:38.700705 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.700691    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-headless-tls\""
Oct 30 21:48:38.706771 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.706750    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-monitoring-tls\""
Oct 30 21:48:38.707025 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.707007    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-a0f9182a\""
Oct 30 21:48:38.707025 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.707015    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-client-cert\""
Oct 30 21:48:38.707153 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.707035    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-collector-dockercfg-h8sc9\""
Oct 30 21:48:38.707778 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.707758    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:48:38.710985 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.710968    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:38.753101 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.753071    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:48:38.778329 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.778297    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-perses-config\""
Oct 30 21:48:38.799878 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.799837    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2j4z\" (UniqueName: \"kubernetes.io/projected/24b9850d-fec1-4b53-a196-76bb3bfda603-kube-api-access-w2j4z\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.800085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.799891    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.800085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.799934    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.800085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.799971    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.800085 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.800011    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.800291 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.800129    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/24b9850d-fec1-4b53-a196-76bb3bfda603-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.801138 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.801107    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/24b9850d-fec1-4b53-a196-76bb3bfda603-otc-internal\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.802996 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.802974    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-data-science-collector-ta-client-cert\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.803135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.803033    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.803135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.803069    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-monitoring-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.803135 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.803081    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-otlp-tls-certs\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.865445 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.865369    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2j4z\" (UniqueName: \"kubernetes.io/projected/24b9850d-fec1-4b53-a196-76bb3bfda603-kube-api-access-w2j4z\") pod \"data-science-collector-collector-1\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") " pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.895598 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.895558    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"]
Oct 30 21:48:38.900052 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.900034    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:38.900609 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.900583    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/7e362f3a-2227-48a3-83b3-23cab11286ec-plugins\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:38.900729 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.900693    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7z49\" (UniqueName: \"kubernetes.io/projected/7e362f3a-2227-48a3-83b3-23cab11286ec-kube-api-access-s7z49\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:38.900780 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.900750    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e362f3a-2227-48a3-83b3-23cab11286ec-config\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:38.908316 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.908293    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:48:38.959852 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.957616    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator-dockercfg-t8wgm\""
Oct 30 21:48:38.959852 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.959032    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"]
Oct 30 21:48:38.959852 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.959714    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-targetallocator\""
Oct 30 21:48:38.959852 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:38.959817    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ods-monitoring\"/\"data-science-collector-ta-server-cert\""
Oct 30 21:48:39.001189 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.001150    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7z49\" (UniqueName: \"kubernetes.io/projected/7e362f3a-2227-48a3-83b3-23cab11286ec-kube-api-access-s7z49\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:39.001348 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.001197    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/141d15db-ed59-4f36-a3bb-a74d67bb1381-ta-internal\") pod \"data-science-collector-targetallocator-96bddbc54-mx5rw\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.001348 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.001237    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e362f3a-2227-48a3-83b3-23cab11286ec-config\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:39.001348 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.001267    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-796tm\" (UniqueName: \"kubernetes.io/projected/141d15db-ed59-4f36-a3bb-a74d67bb1381-kube-api-access-796tm\") pod \"data-science-collector-targetallocator-96bddbc54-mx5rw\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.001504 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.001480    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/7e362f3a-2227-48a3-83b3-23cab11286ec-plugins\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:39.001562 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.001527    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/141d15db-ed59-4f36-a3bb-a74d67bb1381-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-96bddbc54-mx5rw\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.001815 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.001797    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/7e362f3a-2227-48a3-83b3-23cab11286ec-plugins\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:39.001943 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.001925    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e362f3a-2227-48a3-83b3-23cab11286ec-config\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:39.063772 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.063742    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7z49\" (UniqueName: \"kubernetes.io/projected/7e362f3a-2227-48a3-83b3-23cab11286ec-kube-api-access-s7z49\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:39.102620 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.102574    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/141d15db-ed59-4f36-a3bb-a74d67bb1381-ta-internal\") pod \"data-science-collector-targetallocator-96bddbc54-mx5rw\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.102806 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.102661    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-796tm\" (UniqueName: \"kubernetes.io/projected/141d15db-ed59-4f36-a3bb-a74d67bb1381-kube-api-access-796tm\") pod \"data-science-collector-targetallocator-96bddbc54-mx5rw\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.102806 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.102719    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/141d15db-ed59-4f36-a3bb-a74d67bb1381-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-96bddbc54-mx5rw\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.103338 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.103318    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/141d15db-ed59-4f36-a3bb-a74d67bb1381-ta-internal\") pod \"data-science-collector-targetallocator-96bddbc54-mx5rw\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.105264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.105245    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/141d15db-ed59-4f36-a3bb-a74d67bb1381-data-science-collector-ta-server-cert\") pod \"data-science-collector-targetallocator-96bddbc54-mx5rw\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.165302 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.165237    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-796tm\" (UniqueName: \"kubernetes.io/projected/141d15db-ed59-4f36-a3bb-a74d67bb1381-kube-api-access-796tm\") pod \"data-science-collector-targetallocator-96bddbc54-mx5rw\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") " pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.212420 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.212385    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.284862 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.284830    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:48:39.288118 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:48:39.288082    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b9850d_fec1_4b53_a196_76bb3bfda603.slice/crio-8e4c3aa9255be57cf80920eb9ac122bc04a64084d3e7a44eb23da2898220b506 WatchSource:0}: Error finding container 8e4c3aa9255be57cf80920eb9ac122bc04a64084d3e7a44eb23da2898220b506: Status 404 returned error can't find the container with id 8e4c3aa9255be57cf80920eb9ac122bc04a64084d3e7a44eb23da2898220b506
Oct 30 21:48:39.290754 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.290726    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:48:39.290845 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.290785    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:48:39.588699 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.588677    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"]
Oct 30 21:48:39.591078 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:48:39.591048    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod141d15db_ed59_4f36_a3bb_a74d67bb1381.slice/crio-bc2f7f15b1b7c6699b9b70ed51fd5f08f6e37c19f2693c22464fc1fcc1cb5024 WatchSource:0}: Error finding container bc2f7f15b1b7c6699b9b70ed51fd5f08f6e37c19f2693c22464fc1fcc1cb5024: Status 404 returned error can't find the container with id bc2f7f15b1b7c6699b9b70ed51fd5f08f6e37c19f2693c22464fc1fcc1cb5024
Oct 30 21:48:39.593290 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.593260    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:48:39.593590 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.593317    5937 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Oct 30 21:48:39.840437 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.840345    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"24b9850d-fec1-4b53-a196-76bb3bfda603","Type":"ContainerStarted","Data":"fd7b224e0fb67ee0cfeef8a7bd6d09a2eef0ea742473da8086e41b79968557d5"}
Oct 30 21:48:39.840437 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.840407    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"24b9850d-fec1-4b53-a196-76bb3bfda603","Type":"ContainerStarted","Data":"8e4c3aa9255be57cf80920eb9ac122bc04a64084d3e7a44eb23da2898220b506"}
Oct 30 21:48:39.841895 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.841860    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw" event={"ID":"141d15db-ed59-4f36-a3bb-a74d67bb1381","Type":"ContainerStarted","Data":"049ba738ca0a7cbf5c535fb85d3dc2f5dd6bae695b9703c42a7b5eb6dc3477c7"}
Oct 30 21:48:39.841895 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.841894    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw" event={"ID":"141d15db-ed59-4f36-a3bb-a74d67bb1381","Type":"ContainerStarted","Data":"bc2f7f15b1b7c6699b9b70ed51fd5f08f6e37c19f2693c22464fc1fcc1cb5024"}
Oct 30 21:48:39.842051 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.842030    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:39.843063 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.843039    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw" podUID="141d15db-ed59-4f36-a3bb-a74d67bb1381" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.175:8080/readyz\": dial tcp 10.134.0.175:8080: connect: connection refused"
Oct 30 21:48:39.964945 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:39.964894    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-collector-1" podStartSLOduration=1.964879379 podStartE2EDuration="1.964879379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:39.964099092 +0000 UTC m=+4294.920113868" watchObservedRunningTime="2026-10-30 21:48:39.964879379 +0000 UTC m=+4294.920894255"
Oct 30 21:48:40.084944 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:40.084894    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw" podStartSLOduration=2.084876125 podStartE2EDuration="2.084876125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:40.084133072 +0000 UTC m=+4295.040147849" watchObservedRunningTime="2026-10-30 21:48:40.084876125 +0000 UTC m=+4295.040890901"
Oct 30 21:48:40.847354 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:40.847320    5937 prober.go:122] "Probe failed" probeType="Readiness" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw" podUID="141d15db-ed59-4f36-a3bb-a74d67bb1381" containerName="ta-container" probeResult="failure" output="Get \"http://10.134.0.175:8080/readyz\": dial tcp 10.134.0.175:8080: connect: connection refused"
Oct 30 21:48:41.120479 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:41.120409    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:41.226801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:41.226771    5937 operation_generator.go:1464] "Controller attach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") device path: \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:41.321896 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:41.321861    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:41.322039 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:41.321978    5937 operation_generator.go:515] "MountVolume.WaitForAttach entering for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") DevicePath \"\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:41.375130 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:41.375071    5937 operation_generator.go:525] "MountVolume.WaitForAttach succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:41.512733 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:41.512708    5937 operation_generator.go:557] "MountVolume.MountDevice succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/ebs.csi.aws.com/380557c59a72f02ea6ea694dd6c11cb5958ca666e2345aabf726b3fb16068c74/globalmount\"" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:41.581237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:41.581215    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"data-science-perses-0\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") " pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:41.722931 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:41.722903    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:42.095470 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:42.095446    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:48:42.096824 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:48:42.096801    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e362f3a_2227_48a3_83b3_23cab11286ec.slice/crio-4c60836a14ac918334bbd410849289f0808c834d86175969e620018a4e77f0e9 WatchSource:0}: Error finding container 4c60836a14ac918334bbd410849289f0808c834d86175969e620018a4e77f0e9: Status 404 returned error can't find the container with id 4c60836a14ac918334bbd410849289f0808c834d86175969e620018a4e77f0e9
Oct 30 21:48:42.858643 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:42.858611    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"7e362f3a-2227-48a3-83b3-23cab11286ec","Type":"ContainerStarted","Data":"c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168"}
Oct 30 21:48:42.858826 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:42.858654    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"7e362f3a-2227-48a3-83b3-23cab11286ec","Type":"ContainerStarted","Data":"4c60836a14ac918334bbd410849289f0808c834d86175969e620018a4e77f0e9"}
Oct 30 21:48:42.858826 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:42.858801    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:48:43.023556 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:43.023471    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/data-science-perses-0" podStartSLOduration=5.023451731 podStartE2EDuration="5.023451731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:42.979641179 +0000 UTC m=+4297.935655965" watchObservedRunningTime="2026-10-30 21:48:43.023451731 +0000 UTC m=+4297.979466510"
Oct 30 21:48:45.672412 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:48:45.672375    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:48:50.848148 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:50.848120    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:48:50.952797 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:50.952763    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"]
Oct 30 21:48:50.974599 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:50.974569    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"
Oct 30 21:48:51.008984 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:51.008956    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q4n6\" (UniqueName: \"kubernetes.io/projected/859f4b40-cf0f-4b1c-9890-81bd3c1d4243-kube-api-access-5q4n6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-x482z\" (UID: \"859f4b40-cf0f-4b1c-9890-81bd3c1d4243\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"
Oct 30 21:48:51.013949 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:51.013924    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"]
Oct 30 21:48:51.109810 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:51.109725    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q4n6\" (UniqueName: \"kubernetes.io/projected/859f4b40-cf0f-4b1c-9890-81bd3c1d4243-kube-api-access-5q4n6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-x482z\" (UID: \"859f4b40-cf0f-4b1c-9890-81bd3c1d4243\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"
Oct 30 21:48:51.171786 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:51.171753    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q4n6\" (UniqueName: \"kubernetes.io/projected/859f4b40-cf0f-4b1c-9890-81bd3c1d4243-kube-api-access-5q4n6\") pod \"thanos-querier-data-science-thanos-querier-74b6964bcd-x482z\" (UID: \"859f4b40-cf0f-4b1c-9890-81bd3c1d4243\") " pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"
Oct 30 21:48:51.287088 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:51.287058    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"
Oct 30 21:48:51.667322 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:51.667292    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"]
Oct 30 21:48:51.670712 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:48:51.670687    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod859f4b40_cf0f_4b1c_9890_81bd3c1d4243.slice/crio-7be2e1141c6a7c39dd015f8eca638b5b87a540648b2a4abada502bbcdb026aef WatchSource:0}: Error finding container 7be2e1141c6a7c39dd015f8eca638b5b87a540648b2a4abada502bbcdb026aef: Status 404 returned error can't find the container with id 7be2e1141c6a7c39dd015f8eca638b5b87a540648b2a4abada502bbcdb026aef
Oct 30 21:48:51.901043 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:51.901008    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z" event={"ID":"859f4b40-cf0f-4b1c-9890-81bd3c1d4243","Type":"ContainerStarted","Data":"26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b"}
Oct 30 21:48:51.901043 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:51.901055    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z" event={"ID":"859f4b40-cf0f-4b1c-9890-81bd3c1d4243","Type":"ContainerStarted","Data":"7be2e1141c6a7c39dd015f8eca638b5b87a540648b2a4abada502bbcdb026aef"}
Oct 30 21:48:52.021514 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.021441    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z" podStartSLOduration=2.02142284 podStartE2EDuration="2.02142284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:52.021057965 +0000 UTC m=+4306.977072741" watchObservedRunningTime="2026-10-30 21:48:52.02142284 +0000 UTC m=+4306.977437616"
Oct 30 21:48:52.049651 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.049621    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"]
Oct 30 21:48:52.049851 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.049828    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q" podUID="ce51131a-c064-4b18-910c-01ab19af7ff8" containerName="thanos-querier" containerID="cri-o://a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b" gracePeriod=30
Oct 30 21:48:52.288880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.288852    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"
Oct 30 21:48:52.319080 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.319053    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce51131a-c064-4b18-910c-01ab19af7ff8-kube-api-access-tzbpr\" (UniqueName: \"kubernetes.io/projected/ce51131a-c064-4b18-910c-01ab19af7ff8-kube-api-access-tzbpr\") pod \"ce51131a-c064-4b18-910c-01ab19af7ff8\" (UID: \"ce51131a-c064-4b18-910c-01ab19af7ff8\") "
Oct 30 21:48:52.321151 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.321124    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce51131a-c064-4b18-910c-01ab19af7ff8-kube-api-access-tzbpr" pod "ce51131a-c064-4b18-910c-01ab19af7ff8" (UID: "ce51131a-c064-4b18-910c-01ab19af7ff8"). InnerVolumeSpecName "kube-api-access-tzbpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:52.420724 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.420695    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzbpr\" (UniqueName: \"kubernetes.io/projected/ce51131a-c064-4b18-910c-01ab19af7ff8-kube-api-access-tzbpr\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:52.907577 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.907525    5937 generic.go:356] "Generic (PLEG): container finished" podID="ce51131a-c064-4b18-910c-01ab19af7ff8" containerID="a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b" exitCode=0
Oct 30 21:48:52.908025 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.907574    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q" event={"ID":"ce51131a-c064-4b18-910c-01ab19af7ff8","Type":"ContainerDied","Data":"a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b"}
Oct 30 21:48:52.908025 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.907608    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"
Oct 30 21:48:52.908025 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.907626    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q" event={"ID":"ce51131a-c064-4b18-910c-01ab19af7ff8","Type":"ContainerDied","Data":"88b6d6515a5eecb89320efcb86bb50d87305c9c7e5ec00e0d8b2065dc7ee75f3"}
Oct 30 21:48:52.908025 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.907648    5937 scope.go:122] "RemoveContainer" containerID="a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b"
Oct 30 21:48:52.917591 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.917557    5937 scope.go:122] "RemoveContainer" containerID="a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b"
Oct 30 21:48:52.917894 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:48:52.917872    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b\": container with ID starting with a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b not found: ID does not exist" containerID="a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b"
Oct 30 21:48:52.917991 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:52.917902    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b"} err="failed to get container status \"a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b\": rpc error: code = NotFound desc = could not find container \"a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b\": container with ID starting with a54099825d7f9e08e9e965d00f2ee215d221614552bac9a9ee5d8bb0ae1fb53b not found: ID does not exist"
Oct 30 21:48:53.073737 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:53.073710    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"]
Oct 30 21:48:53.124308 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:53.124282    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-69cb6bdcdc-5bw8q"]
Oct 30 21:48:53.166264 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:53.166207    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce51131a-c064-4b18-910c-01ab19af7ff8" path="/var/lib/kubelet/pods/ce51131a-c064-4b18-910c-01ab19af7ff8/volumes"
Oct 30 21:48:53.867057 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:48:53.867027    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:49:15.671864 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:49:15.671784    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:49:34.159809 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:34.159768    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"]
Oct 30 21:49:34.160237 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:34.159933    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z" podUID="859f4b40-cf0f-4b1c-9890-81bd3c1d4243" containerName="thanos-querier" containerID="cri-o://26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b" gracePeriod=30
Oct 30 21:49:34.409661 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:34.409637    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"
Oct 30 21:49:34.573873 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:34.573838    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/859f4b40-cf0f-4b1c-9890-81bd3c1d4243-kube-api-access-5q4n6\" (UniqueName: \"kubernetes.io/projected/859f4b40-cf0f-4b1c-9890-81bd3c1d4243-kube-api-access-5q4n6\") pod \"859f4b40-cf0f-4b1c-9890-81bd3c1d4243\" (UID: \"859f4b40-cf0f-4b1c-9890-81bd3c1d4243\") "
Oct 30 21:49:34.576794 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:34.576761    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/859f4b40-cf0f-4b1c-9890-81bd3c1d4243-kube-api-access-5q4n6" pod "859f4b40-cf0f-4b1c-9890-81bd3c1d4243" (UID: "859f4b40-cf0f-4b1c-9890-81bd3c1d4243"). InnerVolumeSpecName "kube-api-access-5q4n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:34.675427 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:34.675398    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q4n6\" (UniqueName: \"kubernetes.io/projected/859f4b40-cf0f-4b1c-9890-81bd3c1d4243-kube-api-access-5q4n6\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:35.089607 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:35.089569    5937 generic.go:356] "Generic (PLEG): container finished" podID="859f4b40-cf0f-4b1c-9890-81bd3c1d4243" containerID="26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b" exitCode=0
Oct 30 21:49:35.089777 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:35.089616    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"
Oct 30 21:49:35.089777 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:35.089660    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z" event={"ID":"859f4b40-cf0f-4b1c-9890-81bd3c1d4243","Type":"ContainerDied","Data":"26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b"}
Oct 30 21:49:35.089777 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:35.089707    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z" event={"ID":"859f4b40-cf0f-4b1c-9890-81bd3c1d4243","Type":"ContainerDied","Data":"7be2e1141c6a7c39dd015f8eca638b5b87a540648b2a4abada502bbcdb026aef"}
Oct 30 21:49:35.089777 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:35.089727    5937 scope.go:122] "RemoveContainer" containerID="26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b"
Oct 30 21:49:35.098694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:35.098677    5937 scope.go:122] "RemoveContainer" containerID="26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b"
Oct 30 21:49:35.098966 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:49:35.098950    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b\": container with ID starting with 26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b not found: ID does not exist" containerID="26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b"
Oct 30 21:49:35.099014 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:35.098975    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b"} err="failed to get container status \"26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b\": rpc error: code = NotFound desc = could not find container \"26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b\": container with ID starting with 26e5b529d8f634a72b4b1d0722639a056cad9a2d8c3360ce7296b4a408ae452b not found: ID does not exist"
Oct 30 21:49:35.255312 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:35.255282    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"]
Oct 30 21:49:35.305797 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:35.305769    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/thanos-querier-data-science-thanos-querier-74b6964bcd-x482z"]
Oct 30 21:49:36.843503 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:36.843456    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:49:36.843988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:36.843759    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-collector-1" podUID="24b9850d-fec1-4b53-a196-76bb3bfda603" containerName="otc-container" containerID="cri-o://fd7b224e0fb67ee0cfeef8a7bd6d09a2eef0ea742473da8086e41b79968557d5" gracePeriod=30
Oct 30 21:49:36.892060 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:36.892035    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"]
Oct 30 21:49:36.892248 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:36.892229    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw" podUID="141d15db-ed59-4f36-a3bb-a74d67bb1381" containerName="ta-container" containerID="cri-o://049ba738ca0a7cbf5c535fb85d3dc2f5dd6bae695b9703c42a7b5eb6dc3477c7" gracePeriod=30
Oct 30 21:49:37.113114 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.112855    5937 generic.go:356] "Generic (PLEG): container finished" podID="141d15db-ed59-4f36-a3bb-a74d67bb1381" containerID="049ba738ca0a7cbf5c535fb85d3dc2f5dd6bae695b9703c42a7b5eb6dc3477c7" exitCode=0
Oct 30 21:49:37.113114 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.112951    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw" event={"ID":"141d15db-ed59-4f36-a3bb-a74d67bb1381","Type":"ContainerDied","Data":"049ba738ca0a7cbf5c535fb85d3dc2f5dd6bae695b9703c42a7b5eb6dc3477c7"}
Oct 30 21:49:37.115479 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.115454    5937 generic.go:356] "Generic (PLEG): container finished" podID="24b9850d-fec1-4b53-a196-76bb3bfda603" containerID="fd7b224e0fb67ee0cfeef8a7bd6d09a2eef0ea742473da8086e41b79968557d5" exitCode=0
Oct 30 21:49:37.115664 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.115498    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"24b9850d-fec1-4b53-a196-76bb3bfda603","Type":"ContainerDied","Data":"fd7b224e0fb67ee0cfeef8a7bd6d09a2eef0ea742473da8086e41b79968557d5"}
Oct 30 21:49:37.145963 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.145860    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:49:37.146108 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.146064    5937 kuberuntime_container.go:898] "Killing container with a grace period" pod="redhat-ods-monitoring/data-science-perses-0" podUID="7e362f3a-2227-48a3-83b3-23cab11286ec" containerName="perses" containerID="cri-o://c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168" gracePeriod=30
Oct 30 21:49:37.161749 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.161557    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="859f4b40-cf0f-4b1c-9890-81bd3c1d4243" path="/var/lib/kubelet/pods/859f4b40-cf0f-4b1c-9890-81bd3c1d4243/volumes"
Oct 30 21:49:37.228992 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.228969    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:49:37.232238 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.232219    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:49:37.390511 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.390488    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:49:37.402606 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.402579    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-monitoring-tls-certs\") pod \"24b9850d-fec1-4b53-a196-76bb3bfda603\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") "
Oct 30 21:49:37.402720 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.402628    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24b9850d-fec1-4b53-a196-76bb3bfda603-otc-internal\" (UniqueName: \"kubernetes.io/configmap/24b9850d-fec1-4b53-a196-76bb3bfda603-otc-internal\") pod \"24b9850d-fec1-4b53-a196-76bb3bfda603\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") "
Oct 30 21:49:37.402720 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.402657    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-otlp-tls-certs\") pod \"24b9850d-fec1-4b53-a196-76bb3bfda603\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") "
Oct 30 21:49:37.402720 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.402692    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-data-science-collector-ta-client-cert\") pod \"24b9850d-fec1-4b53-a196-76bb3bfda603\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") "
Oct 30 21:49:37.402898 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.402736    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/141d15db-ed59-4f36-a3bb-a74d67bb1381-kube-api-access-796tm\" (UniqueName: \"kubernetes.io/projected/141d15db-ed59-4f36-a3bb-a74d67bb1381-kube-api-access-796tm\") pod \"141d15db-ed59-4f36-a3bb-a74d67bb1381\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") "
Oct 30 21:49:37.402898 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.402763    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24b9850d-fec1-4b53-a196-76bb3bfda603-kube-api-access-w2j4z\" (UniqueName: \"kubernetes.io/projected/24b9850d-fec1-4b53-a196-76bb3bfda603-kube-api-access-w2j4z\") pod \"24b9850d-fec1-4b53-a196-76bb3bfda603\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") "
Oct 30 21:49:37.402898 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.402798    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/141d15db-ed59-4f36-a3bb-a74d67bb1381-data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/141d15db-ed59-4f36-a3bb-a74d67bb1381-data-science-collector-ta-server-cert\") pod \"141d15db-ed59-4f36-a3bb-a74d67bb1381\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") "
Oct 30 21:49:37.402898 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.402839    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-tls-certs\") pod \"24b9850d-fec1-4b53-a196-76bb3bfda603\" (UID: \"24b9850d-fec1-4b53-a196-76bb3bfda603\") "
Oct 30 21:49:37.403124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.402902    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/141d15db-ed59-4f36-a3bb-a74d67bb1381-ta-internal\" (UniqueName: \"kubernetes.io/configmap/141d15db-ed59-4f36-a3bb-a74d67bb1381-ta-internal\") pod \"141d15db-ed59-4f36-a3bb-a74d67bb1381\" (UID: \"141d15db-ed59-4f36-a3bb-a74d67bb1381\") "
Oct 30 21:49:37.403124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.403014    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b9850d-fec1-4b53-a196-76bb3bfda603-otc-internal" pod "24b9850d-fec1-4b53-a196-76bb3bfda603" (UID: "24b9850d-fec1-4b53-a196-76bb3bfda603"). InnerVolumeSpecName "otc-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:37.403279 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.403252    5937 reconciler_common.go:299] "Volume detached for volume \"otc-internal\" (UniqueName: \"kubernetes.io/configmap/24b9850d-fec1-4b53-a196-76bb3bfda603-otc-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.403857 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.403790    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/141d15db-ed59-4f36-a3bb-a74d67bb1381-ta-internal" pod "141d15db-ed59-4f36-a3bb-a74d67bb1381" (UID: "141d15db-ed59-4f36-a3bb-a74d67bb1381"). InnerVolumeSpecName "ta-internal". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:37.405379 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.405336    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-data-science-collector-ta-client-cert" pod "24b9850d-fec1-4b53-a196-76bb3bfda603" (UID: "24b9850d-fec1-4b53-a196-76bb3bfda603"). InnerVolumeSpecName "data-science-collector-ta-client-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:37.405664 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.405636    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-otlp-tls-certs" pod "24b9850d-fec1-4b53-a196-76bb3bfda603" (UID: "24b9850d-fec1-4b53-a196-76bb3bfda603"). InnerVolumeSpecName "otlp-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:37.405796 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.405774    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-monitoring-tls-certs" pod "24b9850d-fec1-4b53-a196-76bb3bfda603" (UID: "24b9850d-fec1-4b53-a196-76bb3bfda603"). InnerVolumeSpecName "monitoring-tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:37.405796 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.405782    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/141d15db-ed59-4f36-a3bb-a74d67bb1381-kube-api-access-796tm" pod "141d15db-ed59-4f36-a3bb-a74d67bb1381" (UID: "141d15db-ed59-4f36-a3bb-a74d67bb1381"). InnerVolumeSpecName "kube-api-access-796tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:37.405896 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.405782    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/141d15db-ed59-4f36-a3bb-a74d67bb1381-data-science-collector-ta-server-cert" pod "141d15db-ed59-4f36-a3bb-a74d67bb1381" (UID: "141d15db-ed59-4f36-a3bb-a74d67bb1381"). InnerVolumeSpecName "data-science-collector-ta-server-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:37.405896 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.405880    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b9850d-fec1-4b53-a196-76bb3bfda603-kube-api-access-w2j4z" pod "24b9850d-fec1-4b53-a196-76bb3bfda603" (UID: "24b9850d-fec1-4b53-a196-76bb3bfda603"). InnerVolumeSpecName "kube-api-access-w2j4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:37.406003 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.405990    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-tls-certs" pod "24b9850d-fec1-4b53-a196-76bb3bfda603" (UID: "24b9850d-fec1-4b53-a196-76bb3bfda603"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:49:37.504146 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.504110    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") pod \"7e362f3a-2227-48a3-83b3-23cab11286ec\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") "
Oct 30 21:49:37.504293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.504180    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e362f3a-2227-48a3-83b3-23cab11286ec-config\" (UniqueName: \"kubernetes.io/configmap/7e362f3a-2227-48a3-83b3-23cab11286ec-config\") pod \"7e362f3a-2227-48a3-83b3-23cab11286ec\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") "
Oct 30 21:49:37.504293 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.504251    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e362f3a-2227-48a3-83b3-23cab11286ec-kube-api-access-s7z49\" (UniqueName: \"kubernetes.io/projected/7e362f3a-2227-48a3-83b3-23cab11286ec-kube-api-access-s7z49\") pod \"7e362f3a-2227-48a3-83b3-23cab11286ec\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") "
Oct 30 21:49:37.504418 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.504304    5937 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7e362f3a-2227-48a3-83b3-23cab11286ec-plugins\" (UniqueName: \"kubernetes.io/empty-dir/7e362f3a-2227-48a3-83b3-23cab11286ec-plugins\") pod \"7e362f3a-2227-48a3-83b3-23cab11286ec\" (UID: \"7e362f3a-2227-48a3-83b3-23cab11286ec\") "
Oct 30 21:49:37.505136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.504923    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-796tm\" (UniqueName: \"kubernetes.io/projected/141d15db-ed59-4f36-a3bb-a74d67bb1381-kube-api-access-796tm\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.505136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.504951    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2j4z\" (UniqueName: \"kubernetes.io/projected/24b9850d-fec1-4b53-a196-76bb3bfda603-kube-api-access-w2j4z\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.505136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.504968    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-server-cert\" (UniqueName: \"kubernetes.io/secret/141d15db-ed59-4f36-a3bb-a74d67bb1381-data-science-collector-ta-server-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.505136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.504987    5937 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.505136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.505001    5937 reconciler_common.go:299] "Volume detached for volume \"ta-internal\" (UniqueName: \"kubernetes.io/configmap/141d15db-ed59-4f36-a3bb-a74d67bb1381-ta-internal\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.505136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.505015    5937 reconciler_common.go:299] "Volume detached for volume \"monitoring-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-monitoring-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.505136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.505028    5937 reconciler_common.go:299] "Volume detached for volume \"otlp-tls-certs\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-otlp-tls-certs\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.505136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.505094    5937 reconciler_common.go:299] "Volume detached for volume \"data-science-collector-ta-client-cert\" (UniqueName: \"kubernetes.io/secret/24b9850d-fec1-4b53-a196-76bb3bfda603-data-science-collector-ta-client-cert\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.505136 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.505092    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e362f3a-2227-48a3-83b3-23cab11286ec-config" pod "7e362f3a-2227-48a3-83b3-23cab11286ec" (UID: "7e362f3a-2227-48a3-83b3-23cab11286ec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:37.507257 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.507229    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e362f3a-2227-48a3-83b3-23cab11286ec-kube-api-access-s7z49" pod "7e362f3a-2227-48a3-83b3-23cab11286ec" (UID: "7e362f3a-2227-48a3-83b3-23cab11286ec"). InnerVolumeSpecName "kube-api-access-s7z49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:37.507613 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.507591    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906" pod "7e362f3a-2227-48a3-83b3-23cab11286ec" (UID: "7e362f3a-2227-48a3-83b3-23cab11286ec"). InnerVolumeSpecName "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de". PluginName "kubernetes.io/csi", VolumeGIDValue ""
Oct 30 21:49:37.605920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.605893    5937 reconciler_common.go:292] "operationExecutor.UnmountDevice started for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" "
Oct 30 21:49:37.605920 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.605917    5937 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7e362f3a-2227-48a3-83b3-23cab11286ec-config\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.606184 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.605929    5937 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7z49\" (UniqueName: \"kubernetes.io/projected/7e362f3a-2227-48a3-83b3-23cab11286ec-kube-api-access-s7z49\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.615709 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.615692    5937 operation_generator.go:893] UnmountDevice succeeded for volume "pvc-b2a69eb6-850b-44a0-9a56-d575531f25de" (UniqueName: "kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906") on node "ip-10-0-141-37.us-west-1.compute.internal"
Oct 30 21:49:37.656717 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.656644    5937 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e362f3a-2227-48a3-83b3-23cab11286ec-plugins" pod "7e362f3a-2227-48a3-83b3-23cab11286ec" (UID: "7e362f3a-2227-48a3-83b3-23cab11286ec"). InnerVolumeSpecName "plugins". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:37.707226 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.707202    5937 reconciler_common.go:299] "Volume detached for volume \"plugins\" (UniqueName: \"kubernetes.io/empty-dir/7e362f3a-2227-48a3-83b3-23cab11286ec-plugins\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:37.707226 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:37.707226    5937 reconciler_common.go:299] "Volume detached for volume \"pvc-b2a69eb6-850b-44a0-9a56-d575531f25de\" (UniqueName: \"kubernetes.io/csi/ebs.csi.aws.com^vol-0206a2a8691946906\") on node \"ip-10-0-141-37.us-west-1.compute.internal\" DevicePath \"csi-3765dd418294a104a2fd0450d1d4094842abf82489e318f99f63d3d6a84124e3\""
Oct 30 21:49:38.121141 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.121112    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-collector-1"
Oct 30 21:49:38.121671 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.121117    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-collector-1" event={"ID":"24b9850d-fec1-4b53-a196-76bb3bfda603","Type":"ContainerDied","Data":"8e4c3aa9255be57cf80920eb9ac122bc04a64084d3e7a44eb23da2898220b506"}
Oct 30 21:49:38.121671 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.121254    5937 scope.go:122] "RemoveContainer" containerID="fd7b224e0fb67ee0cfeef8a7bd6d09a2eef0ea742473da8086e41b79968557d5"
Oct 30 21:49:38.122694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.122495    5937 generic.go:356] "Generic (PLEG): container finished" podID="7e362f3a-2227-48a3-83b3-23cab11286ec" containerID="c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168" exitCode=0
Oct 30 21:49:38.122694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.122568    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-perses-0"
Oct 30 21:49:38.122694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.122571    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"7e362f3a-2227-48a3-83b3-23cab11286ec","Type":"ContainerDied","Data":"c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168"}
Oct 30 21:49:38.122694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.122613    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-perses-0" event={"ID":"7e362f3a-2227-48a3-83b3-23cab11286ec","Type":"ContainerDied","Data":"4c60836a14ac918334bbd410849289f0808c834d86175969e620018a4e77f0e9"}
Oct 30 21:49:38.129700 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.129678    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw" event={"ID":"141d15db-ed59-4f36-a3bb-a74d67bb1381","Type":"ContainerDied","Data":"bc2f7f15b1b7c6699b9b70ed51fd5f08f6e37c19f2693c22464fc1fcc1cb5024"}
Oct 30 21:49:38.129801 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.129710    5937 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"
Oct 30 21:49:38.130327 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.130308    5937 scope.go:122] "RemoveContainer" containerID="c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168"
Oct 30 21:49:38.139690 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.139666    5937 scope.go:122] "RemoveContainer" containerID="c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168"
Oct 30 21:49:38.140027 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:49:38.139919    5937 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168\": container with ID starting with c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168 not found: ID does not exist" containerID="c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168"
Oct 30 21:49:38.140027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.139964    5937 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168"} err="failed to get container status \"c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168\": rpc error: code = NotFound desc = could not find container \"c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168\": container with ID starting with c04aa3d41d0b8c599a33d322077f42195129dd6fb3677e8781071b91208e9168 not found: ID does not exist"
Oct 30 21:49:38.140027 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.139988    5937 scope.go:122] "RemoveContainer" containerID="049ba738ca0a7cbf5c535fb85d3dc2f5dd6bae695b9703c42a7b5eb6dc3477c7"
Oct 30 21:49:38.287448 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.287419    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"]
Oct 30 21:49:38.292012 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.291990    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-targetallocator-96bddbc54-mx5rw"]
Oct 30 21:49:38.403309 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.403244    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:49:38.407704 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.407682    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-perses-0"]
Oct 30 21:49:38.519811 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.519784    5937 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:49:38.524225 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:38.524197    5937 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["redhat-ods-monitoring/data-science-collector-collector-1"]
Oct 30 21:49:39.160864 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:39.160834    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="141d15db-ed59-4f36-a3bb-a74d67bb1381" path="/var/lib/kubelet/pods/141d15db-ed59-4f36-a3bb-a74d67bb1381/volumes"
Oct 30 21:49:39.161270 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:39.161206    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24b9850d-fec1-4b53-a196-76bb3bfda603" path="/var/lib/kubelet/pods/24b9850d-fec1-4b53-a196-76bb3bfda603/volumes"
Oct 30 21:49:39.161600 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:49:39.161586    5937 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7e362f3a-2227-48a3-83b3-23cab11286ec" path="/var/lib/kubelet/pods/7e362f3a-2227-48a3-83b3-23cab11286ec/volumes"
Oct 30 21:49:45.670730 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:49:45.670685    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:50:10.506415 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506381    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dfcks/must-gather-vfkd6"]
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506702    5937 cpu_manager.go:414] "containerMap: removing container" podUID="24b9850d-fec1-4b53-a196-76bb3bfda603" containerName="otc-container"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506713    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24b9850d-fec1-4b53-a196-76bb3bfda603" containerName="otc-container"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506728    5937 cpu_manager.go:414] "containerMap: removing container" podUID="7e362f3a-2227-48a3-83b3-23cab11286ec" containerName="perses"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506733    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e362f3a-2227-48a3-83b3-23cab11286ec" containerName="perses"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506748    5937 cpu_manager.go:414] "containerMap: removing container" podUID="ce51131a-c064-4b18-910c-01ab19af7ff8" containerName="thanos-querier"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506753    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce51131a-c064-4b18-910c-01ab19af7ff8" containerName="thanos-querier"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506767    5937 cpu_manager.go:414] "containerMap: removing container" podUID="141d15db-ed59-4f36-a3bb-a74d67bb1381" containerName="ta-container"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506771    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="141d15db-ed59-4f36-a3bb-a74d67bb1381" containerName="ta-container"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506782    5937 cpu_manager.go:414] "containerMap: removing container" podUID="859f4b40-cf0f-4b1c-9890-81bd3c1d4243" containerName="thanos-querier"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506787    5937 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="859f4b40-cf0f-4b1c-9890-81bd3c1d4243" containerName="thanos-querier"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506839    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="24b9850d-fec1-4b53-a196-76bb3bfda603" containerName="otc-container"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506846    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e362f3a-2227-48a3-83b3-23cab11286ec" containerName="perses"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506853    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce51131a-c064-4b18-910c-01ab19af7ff8" containerName="thanos-querier"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506860    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="141d15db-ed59-4f36-a3bb-a74d67bb1381" containerName="ta-container"
Oct 30 21:50:10.506880 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.506865    5937 memory_manager.go:365] "RemoveStaleState removing state" podUID="859f4b40-cf0f-4b1c-9890-81bd3c1d4243" containerName="thanos-querier"
Oct 30 21:50:10.511160 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.511144    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dfcks/must-gather-vfkd6"
Oct 30 21:50:10.569762 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.569732    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5w95\" (UniqueName: \"kubernetes.io/projected/351785af-702a-4a7a-a206-9f765d006c30-kube-api-access-r5w95\") pod \"must-gather-vfkd6\" (UID: \"351785af-702a-4a7a-a206-9f765d006c30\") " pod="openshift-must-gather-dfcks/must-gather-vfkd6"
Oct 30 21:50:10.569887 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.569804    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/351785af-702a-4a7a-a206-9f765d006c30-must-gather-output\") pod \"must-gather-vfkd6\" (UID: \"351785af-702a-4a7a-a206-9f765d006c30\") " pod="openshift-must-gather-dfcks/must-gather-vfkd6"
Oct 30 21:50:10.617426 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.617402    5937 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dfcks\"/\"default-dockercfg-k474x\""
Oct 30 21:50:10.617426 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.617416    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dfcks\"/\"kube-root-ca.crt\""
Oct 30 21:50:10.617619 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.617478    5937 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dfcks\"/\"openshift-service-ca.crt\""
Oct 30 21:50:10.618124 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.618106    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dfcks/must-gather-vfkd6"]
Oct 30 21:50:10.670288 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.670259    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5w95\" (UniqueName: \"kubernetes.io/projected/351785af-702a-4a7a-a206-9f765d006c30-kube-api-access-r5w95\") pod \"must-gather-vfkd6\" (UID: \"351785af-702a-4a7a-a206-9f765d006c30\") " pod="openshift-must-gather-dfcks/must-gather-vfkd6"
Oct 30 21:50:10.670413 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.670320    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/351785af-702a-4a7a-a206-9f765d006c30-must-gather-output\") pod \"must-gather-vfkd6\" (UID: \"351785af-702a-4a7a-a206-9f765d006c30\") " pod="openshift-must-gather-dfcks/must-gather-vfkd6"
Oct 30 21:50:10.670694 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.670677    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/351785af-702a-4a7a-a206-9f765d006c30-must-gather-output\") pod \"must-gather-vfkd6\" (UID: \"351785af-702a-4a7a-a206-9f765d006c30\") " pod="openshift-must-gather-dfcks/must-gather-vfkd6"
Oct 30 21:50:10.740418 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.740395    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5w95\" (UniqueName: \"kubernetes.io/projected/351785af-702a-4a7a-a206-9f765d006c30-kube-api-access-r5w95\") pod \"must-gather-vfkd6\" (UID: \"351785af-702a-4a7a-a206-9f765d006c30\") " pod="openshift-must-gather-dfcks/must-gather-vfkd6"
Oct 30 21:50:10.824191 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:10.824140    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dfcks/must-gather-vfkd6"
Oct 30 21:50:11.192722 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:11.192570    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dfcks/must-gather-vfkd6"]
Oct 30 21:50:11.195238 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:50:11.195215    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod351785af_702a_4a7a_a206_9f765d006c30.slice/crio-f3a7ef702388ea2f7b16b82dcfdb1e133df7dafa1e8b961c7ac3d30cc47db754 WatchSource:0}: Error finding container f3a7ef702388ea2f7b16b82dcfdb1e133df7dafa1e8b961c7ac3d30cc47db754: Status 404 returned error can't find the container with id f3a7ef702388ea2f7b16b82dcfdb1e133df7dafa1e8b961c7ac3d30cc47db754
Oct 30 21:50:11.196963 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:11.196946    5937 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:50:11.270001 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:11.269974    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dfcks/must-gather-vfkd6" event={"ID":"351785af-702a-4a7a-a206-9f765d006c30","Type":"ContainerStarted","Data":"f3a7ef702388ea2f7b16b82dcfdb1e133df7dafa1e8b961c7ac3d30cc47db754"}
Oct 30 21:50:13.280198 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:13.280164    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dfcks/must-gather-vfkd6" event={"ID":"351785af-702a-4a7a-a206-9f765d006c30","Type":"ContainerStarted","Data":"97c61218477fb1083c993832ce989db58299adb2da6b86541bc606ba49f75ff3"}
Oct 30 21:50:13.280614 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:13.280213    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dfcks/must-gather-vfkd6" event={"ID":"351785af-702a-4a7a-a206-9f765d006c30","Type":"ContainerStarted","Data":"ceb41fcd5ab94a91b205e6a022fb04100901897894a4b37c34d68addf15e306b"}
Oct 30 21:50:13.402514 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:13.402455    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-dfcks/must-gather-vfkd6" podStartSLOduration=2.193689009 podStartE2EDuration="3.402441031s" totalImagesPullingTime="1.208752022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:13.402048847 +0000 UTC m=+4388.358063635" watchObservedRunningTime="2026-10-30 21:50:13.402441031 +0000 UTC m=+4388.358455815"
Oct 30 21:50:15.672206 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:50:15.672174    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:50:20.462823 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:20.461616    5937 ???:1] "http: TLS handshake error from 10.0.141.115:59156: EOF"
Oct 30 21:50:20.535766 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:20.535738    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2r44p_12273a1e-7592-4750-a6e2-58855d489834/global-pull-secret-syncer/0.log"
Oct 30 21:50:24.195617 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:24.195581    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qfhrk_ad5deab8-b21e-49be-ba98-36639a81e88d/konnectivity-agent/0.log"
Oct 30 21:50:25.236214 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:25.236181    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-37.us-west-1.compute.internal_8b6a03677cd7bdfb119e5441f3717b20/haproxy/0.log"
Oct 30 21:50:28.253244 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:28.253214    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e1daa3d8-62fd-42cc-9621-dfd1606010ce/alertmanager/0.log"
Oct 30 21:50:28.685359 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:28.685280    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e1daa3d8-62fd-42cc-9621-dfd1606010ce/config-reloader/0.log"
Oct 30 21:50:29.108156 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.108129    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e1daa3d8-62fd-42cc-9621-dfd1606010ce/kube-rbac-proxy-web/0.log"
Oct 30 21:50:29.518774 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.518744    5937 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"]
Oct 30 21:50:29.524609 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.524583    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.570430 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.570398    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e1daa3d8-62fd-42cc-9621-dfd1606010ce/kube-rbac-proxy/0.log"
Oct 30 21:50:29.580561 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.580305    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"]
Oct 30 21:50:29.599390 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.599357    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-sys\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.599390 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.599395    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-proc\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.599671 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.599413    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5x5c\" (UniqueName: \"kubernetes.io/projected/349c2349-ae76-425d-b94c-3fe3109c2a05-kube-api-access-c5x5c\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.599671 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.599637    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-podres\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.599771 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.599694    5937 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-lib-modules\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.700786 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.700752    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-sys\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.700988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.700802    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-proc\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.700988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.700821    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5x5c\" (UniqueName: \"kubernetes.io/projected/349c2349-ae76-425d-b94c-3fe3109c2a05-kube-api-access-c5x5c\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.700988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.700853    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-sys\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.700988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.700903    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-podres\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.700988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.700916    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-proc\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.700988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.700970    5937 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-lib-modules\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.700988 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.700984    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-podres\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.701401 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.701054    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/349c2349-ae76-425d-b94c-3fe3109c2a05-lib-modules\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.763665 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.763621    5937 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5x5c\" (UniqueName: \"kubernetes.io/projected/349c2349-ae76-425d-b94c-3fe3109c2a05-kube-api-access-c5x5c\") pod \"perf-node-gather-daemonset-q5xrl\" (UID: \"349c2349-ae76-425d-b94c-3fe3109c2a05\") " pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.840809 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.840725    5937 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:29.997727 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:29.997681    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e1daa3d8-62fd-42cc-9621-dfd1606010ce/kube-rbac-proxy-metric/0.log"
Oct 30 21:50:30.256064 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:30.256040    5937 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"]
Oct 30 21:50:30.258197 ip-10-0-141-37 kubenswrapper[5937]: W1030 21:50:30.258169    5937 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod349c2349_ae76_425d_b94c_3fe3109c2a05.slice/crio-8f4eb5804e059295fabce15e7775eab8c9b18e4e9157460338884d03a4de8967 WatchSource:0}: Error finding container 8f4eb5804e059295fabce15e7775eab8c9b18e4e9157460338884d03a4de8967: Status 404 returned error can't find the container with id 8f4eb5804e059295fabce15e7775eab8c9b18e4e9157460338884d03a4de8967
Oct 30 21:50:30.377980 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:30.377952    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl" event={"ID":"349c2349-ae76-425d-b94c-3fe3109c2a05","Type":"ContainerStarted","Data":"8f4eb5804e059295fabce15e7775eab8c9b18e4e9157460338884d03a4de8967"}
Oct 30 21:50:30.446821 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:30.446788    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e1daa3d8-62fd-42cc-9621-dfd1606010ce/prom-label-proxy/0.log"
Oct 30 21:50:30.866192 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:30.866168    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e1daa3d8-62fd-42cc-9621-dfd1606010ce/init-config-reloader/0.log"
Oct 30 21:50:31.384134 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:31.384096    5937 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl" event={"ID":"349c2349-ae76-425d-b94c-3fe3109c2a05","Type":"ContainerStarted","Data":"b8f3e180a06e80a56688a596daa5fdc8ee009c0cf6b966be2d4c87e824a08d87"}
Oct 30 21:50:31.384299 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:31.384165    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:31.502748 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:31.502696    5937 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl" podStartSLOduration=2.5026837090000003 podStartE2EDuration="2.502683709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:50:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:31.502453777 +0000 UTC m=+4406.458468565" watchObservedRunningTime="2026-10-30 21:50:31.502683709 +0000 UTC m=+4406.458698486"
Oct 30 21:50:31.823223 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:31.823194    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-c9q7b_f1788d1c-9101-4856-933c-199b6ced5caa/kube-state-metrics/0.log"
Oct 30 21:50:32.237285 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:32.237242    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-c9q7b_f1788d1c-9101-4856-933c-199b6ced5caa/kube-rbac-proxy-main/0.log"
Oct 30 21:50:32.656184 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:32.656095    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-c9q7b_f1788d1c-9101-4856-933c-199b6ced5caa/kube-rbac-proxy-self/0.log"
Oct 30 21:50:33.085218 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:33.085184    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75fcff69cb-6r6fm_0cb0dbc9-7c90-4df9-a53f-fb5a7163993a/metrics-server/0.log"
Oct 30 21:50:33.506358 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:33.506327    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-vmk7p_15ec14b2-fe21-4c77-b9ed-6bf134a5e38b/monitoring-plugin/0.log"
Oct 30 21:50:33.932108 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:33.932030    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4mlm5_6987d150-7d2e-425b-8408-a64895782e1d/node-exporter/0.log"
Oct 30 21:50:34.395185 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:34.395155    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4mlm5_6987d150-7d2e-425b-8408-a64895782e1d/kube-rbac-proxy/0.log"
Oct 30 21:50:34.825296 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:34.825269    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4mlm5_6987d150-7d2e-425b-8408-a64895782e1d/init-textfile/0.log"
Oct 30 21:50:37.399186 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:37.399162    5937 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dfcks/perf-node-gather-daemonset-q5xrl"
Oct 30 21:50:37.816905 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:37.816873    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-ssh6v_ef9c0987-5531-4120-9ad2-fc7124ee8d5d/kube-rbac-proxy-main/0.log"
Oct 30 21:50:38.237271 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:38.237170    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-ssh6v_ef9c0987-5531-4120-9ad2-fc7124ee8d5d/kube-rbac-proxy-self/0.log"
Oct 30 21:50:38.665579 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:38.665457    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-ssh6v_ef9c0987-5531-4120-9ad2-fc7124ee8d5d/openshift-state-metrics/0.log"
Oct 30 21:50:39.101162 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:39.101128    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_63cba104-6b8b-4503-91aa-724269bcf213/prometheus/0.log"
Oct 30 21:50:39.531663 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:39.531632    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_63cba104-6b8b-4503-91aa-724269bcf213/config-reloader/0.log"
Oct 30 21:50:39.976157 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:39.976122    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_63cba104-6b8b-4503-91aa-724269bcf213/thanos-sidecar/0.log"
Oct 30 21:50:40.443143 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:40.443063    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_63cba104-6b8b-4503-91aa-724269bcf213/kube-rbac-proxy-web/0.log"
Oct 30 21:50:40.871247 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:40.871221    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_63cba104-6b8b-4503-91aa-724269bcf213/kube-rbac-proxy/0.log"
Oct 30 21:50:41.291606 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:41.291580    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_63cba104-6b8b-4503-91aa-724269bcf213/kube-rbac-proxy-thanos/0.log"
Oct 30 21:50:41.716022 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:41.715979    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_63cba104-6b8b-4503-91aa-724269bcf213/init-config-reloader/0.log"
Oct 30 21:50:43.428723 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:43.428689    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57d58748d4-z9zfx_813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/telemeter-client/0.log"
Oct 30 21:50:43.846896 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:43.846860    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57d58748d4-z9zfx_813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/reload/0.log"
Oct 30 21:50:44.284488 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:44.284403    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57d58748d4-z9zfx_813e0b08-c4e4-41e2-a7c5-a72e06aeecc2/kube-rbac-proxy/0.log"
Oct 30 21:50:44.725208 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:44.725180    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf7bf59f-ssgss_9361050c-c0f0-4eff-a31e-7fa06644b9b8/thanos-query/0.log"
Oct 30 21:50:45.144706 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:45.144617    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf7bf59f-ssgss_9361050c-c0f0-4eff-a31e-7fa06644b9b8/kube-rbac-proxy-web/0.log"
Oct 30 21:50:45.564364 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:45.564339    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf7bf59f-ssgss_9361050c-c0f0-4eff-a31e-7fa06644b9b8/kube-rbac-proxy/0.log"
Oct 30 21:50:45.677606 ip-10-0-141-37 kubenswrapper[5937]: E1030 21:50:45.677566    5937 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-42h66" containerName="extractor"
Oct 30 21:50:45.983713 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:45.983683    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf7bf59f-ssgss_9361050c-c0f0-4eff-a31e-7fa06644b9b8/prom-label-proxy/0.log"
Oct 30 21:50:46.409321 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:46.409250    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf7bf59f-ssgss_9361050c-c0f0-4eff-a31e-7fa06644b9b8/kube-rbac-proxy-rules/0.log"
Oct 30 21:50:46.838255 ip-10-0-141-37 kubenswrapper[5937]: I1030 21:50:46.838227    5937 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ccf7bf59f-ssgss_9361050c-c0f0-4eff-a31e-7fa06644b9b8/kube-rbac-proxy-metrics/0.log"